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of Texas at Austin. Data were collected concerning student attitudes 
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characteristics of large classes. In addition, direct observational 
data were collected, the cognitive levels of instructors' tests were 
studied, and instructor interviews were conducted. It was concluded 
that (1) most student's and teachers prefer class size to be under 50 
people; (2) adequate facilities and audiovisual support are 
important; (3) students enjoy large classes more if they are tested 
at higher cognitive levels as in essay tests; (4) student 
participation increases as class size decreases; and (5) effective 
instructors are enthusiastic and knowledgeable lecturers and interact 
with the students well. Appendices include the student attitude 
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I. INTRODUCTION 



The controversy over the effectiveness of teaching/learning 1n large 
classes (which are definec! here as having 100 or more students) at the 
university level has been going on for decades. This controversy has 
resurfaced vigorously within the past few years as enrollments in 
colleges and universities continue to increase and budgets tighten. 
Confronting these large classes often produces frustration and a high 
level of anxiety for many of the faculty members who have to. teach them. 
To assist these individuals, a study of tho teaching techniques used in a 
variety of large classes at the University of Texas at Austin was 
conducted during the 1980-81 academic year. Though substantial research 
has been conducted on the relationship of class siie to student 
achievement, few, if any, of these studies have provjded an in-depth look 
at the methods which are successful for teaching and managing large 
classes. Without the existence of concrete data-based suggestions for 
the "care and maintenance" of large classes, new (and often experienced) 
instructors must experiment and "re-create the wheel" when they are 
confronted with a large class. 

The Purpose of the Study 

The Large Class Analysis Project (LCAP) was conducted primarily to 
accumulate and compile direct observational data concerning the methods 
and procedures used by instructors as they teach large classes at the 
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university level. It was also designed to obtain information concerning 
the students' attitudes toward the learning environment in these large 
classr-^ and their perceptions of the instructor qualities and skills 
needed to teach a large class effectively. The Information gathered 1n 
this study was examined for commonalities and differences- among large 
classes in different disciplines. The elements which combine to produce 
the best student attitudes and learning were also studied. These results 
will be reported in this document and will also be .contained in a booklet 
which will be made available to the faculty members at UT who teach large 
classes. v 

A second set of data will be reported because of its relevance to 
the research community. This set is composed of the following: (1) a 
detailed description of the types of interaction patterns which were 
observed in the large classes which took part in the study; (2) a 
comparison of student attitudes by sex, classification (i.e.. Freshman, 
Sophomore, etc.), college, and instructor; and (3) the factors which seem 
to affect instructor and student attitudes and behavior In large classes. 

Finally, we have Included a list of recommendations to the -^JT 
administration concerning assistance which can be provided to make the 
teachli^g/learning in these large classes more effective and rewarding. 

Limitations of the Study 

In conducting research on teaching in higher education, the 
researcher must design the study so it will Interfere as little as 

» 
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possible in the normal routine of the classes. This means that, such 
studies will have limitations imposed which may not result in the most 
effective research design and some of the information sought will be 
unobtainable. The limitations encountered in the LCAP study consisted 
of: (1) unequal representation in each college; (2) small sample size 
(N=43 instructors); (3) a skawed representation "of teaching abilities, 
(i.e., good teachers volunteered); and (4) uninterested and unsympathetic 
stud^s. 

In the original proposal for the study five classes from each of the 
four representative colleges were to be observed directly. However, 
because the instructors who participated were volunteers, the response to 
assist in such a stu^y was limited and unequal. During the Fall 
semester, 1980, nine classes were observed directly - Business (2), 
Natural Science (5), Liberal Arts (1), and Engineering (1). Ten classes 
were observed during the Spring semester, 1981 - Business (3), Natural 
Science (0), Liberal Arts (6), and Engineering (1). Another 24 faculty 
members - Business (6), Natural Science (2), Liberal Arts (14), 
Engineering (2) - volunteered to be interviewed by one of the LCAP staff 
but did not want their classes observed directly. Because of this rather 
small sample size (observed = 19; total interviewed = 43) it may be 
difficult to relate the results of this study to other instructors or 

r 

other i .titutions. 

The motivation of the participants to take part in a study s^ch as 

this most likely resulted in a skewed representation of teaching 

abilities. The LCAP staff were quite impressed with the overall quality 

I 
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of the teaching skills and techniques which were displayed by the 
observed participants. In the individual interviews with the observed 
participants they were, on thfe whole, quite confident that what they were 
doing in their classrooms was basically effective. However, all of them 
indicated that they had volunteered to participate in the study because . 
they wanted feedback on their teaching techniques which contained 
suggestions for improvement. Thus, the data collected from the 
observations yielded very little information about what techniques 
obviously do not work in large classes. 

Though there were 3820 students enrolled in the 19 classes which 
were observed, only 2571 filled out the Pre-semester Student Attitude 
Survey and 2163 filled out the Post-semester survey. (There were a total 
of 616 students — in two classes in Natural Science — whose classes 
were observed but did not fill out the survey because the instructors 
felt it would take too much class time.^) Many of the students felt that 
filling out a survey such as this was "wasting their time". Some 
students who stayed to fill out the survey commented that they felt 
cheated of valuable class time or that surveys such as this were a waste 
of the University's money. There were a large number of students, 
however, who thanked us for giving them tht opportunity to express their 
opinions about the learning environment in large classes. 

Sources of Data 

I 

Data were collected from several sources for this study. One of the 
primary sources was a Student Attitude Survey (SAS) which was developed 
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by the LCAP staff with the assistance of the Measurement and Evaluation 
Center. (See sample survey form In Appendix B.) This survey ask*d 
students for demographic data, rating of eler«nts in a course which 
enhance or deter their learning, the class sire they prefer, and their 
feelings about large classes- in"general . These data were then compared 
ty college, sex. Classification, major, and preferred class size. 

Another primary source of data was the direct observational codes 
and cor«,ents gathered by the LCAP staff. The verbal interactio^S>.wh1ch 
occurred In the classroom were categorized and coded using the expanV 
Cognitive Interaction Analysis System (CIAS) (see a listing of this 
system and an explanation of Its use In Appendix C.) This gave us a 
detailed picture of the types of verbal activities which took place in 
each class. The classes were then compared by college to determine If 
there were types of Interaction which were unique to a particular 
college. The Interactions of Instructors in the same or similar 
disciplines were also compared. 

Interviews were conducted with the 19 Instructors who allowed us to 
observe their classes as well as 24 other Instructors who have taught 
large classes, A standard set of questions was developed for these 
interviews though sometimes additional information was obtained as the 
LCAP staff member encouraged the faculty member to expand on his or her 
answer. (A list of the questions asked during these Intervi .ws Is 
included in Appendix 0.) These interviews were designed to give us 
insight into the rewards and frustrations In teaching large classes as 
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well as to obtain information concerning the "tricks of the trade" in 
managing the logistics and government of classes with over 100 students. 

The exams and handouts from each observed class were collected ar.'^ 
studied to determine the level of thinking (according to Bloom's 
Taxonomy) which was required in each class. These docutnents also 
provided information concerning: (1) the number of handouts used in 

* 

large classes; (2) the format used in writing these handouts and exams; 
and (3) the type of exams which were given in these large classes. 

Because much of the instructors' frustration with large classes 
seems to come from inadequate facilities and support assistance, we also 
mailed a "Support Assistance Needs" survey to 126 faculty members who 
were teaching large classes during the Spring semester, 1981. (See copy 
of this survey in Appendix E.) (These faculty members included those who 
participated in LCAP but was not restricted to them.) This survey was 
designed to obtain information concerning the problems encountered in 
teaching large classes which are due to (1) poorly designed and equipped 
classrooms, (2) inadequate funds for supplies, and (3) inadequate 
secretarial, TA, and/or clerical assistance. The responses were anjilyzed 
by college and, in some cases, by department. 

These five sources of data (Student Attitude Survey, direct 
observations, interviews, exams and handouts, and Support Assistance 
Needs Survey) provided a wealth of data about the techniques and 
procedures used in teaching large classes here at UT as well as 
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information about tHe attitudes of some of the students and faculty 



members who are involved in these classes. 



The Student Attitude Survey consumed about 25-30 minutes of class time 
each time it was administered. Because of this, two instructors in 
Natural Science allowed an LCAP observer to sit in on their classes but 
asked that we not conduct the survey. '\lso, one instructor who taught 1 
the College of Liberal Arts during the Spring semester, 1981 requested 
that we only administer the survey to the class at the end of the 
semester because there were several surveys which related to the course 
content which were being administered at the beginning of the semester 
and it was felt another one would alienate the students. 
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II, IIEVIEW OF RELATED LITERATURE 

* • 

» ^ 

The question of optimum. class size has bfeen plaguingveducational 
researchers for more than 50 years. Research results indicate that 
student achievement in large lecture classes is not greatly different 
from that in smaller classes when traditional achievement tests (i.e., 
factual knowledge and comprehension) are used as a criterion. However, 
when one looks at the goaVs of higher-level thinking, application, 
motivation and attitudi'ial change, these* are- most likely achieved in 
smaller classes. 

The literature which relates to che subject of optimum class size 
can be divided into (1) those studies which actually comoare classes of 
different sizes. (2) those which look at teaching techniques which are _ 
mor<ii effective in large classes, and (3) the students' evaluations of 
large classes and large class instructors. 

Class size Studies 

As early as 1924 the ffectiveness of the teaching/learning in large 
classes at the university level was being questioned (Edmonson and 
Mulder). In this study a comparison was made of the learning outcomes of 
students enrolled in a 109-student class with students enrolled in a 
43-student class of the same course in education. Both sections of this 
course were taught by the same instructor. Results showed that student 
achievement in both classes was approximately eqi-al but that the students 
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felt that the small class was more efficient. The students also 
preferred the smaller class because there was more personal contact with 
*the instructor and a greater opportunity to participate in the class. 



The b&sic findings of Edmonson and Mulder have been reinforced in 

numerous subsequent studies. Most of these studies are summarized by 

McKeachie (1980) in his review of research on class size. At the end of 

this review McKeachie concludes that 

large lectures are nbt generally inferior to smaller 
lecture classes when traditional achievement tests 
are used as a criterion. When other objectives are 
measured, large lectures are on shakier ground. - 
Goals of higher-level thinking, application, 
motivation, and^ att'itudinal change are most likely tO' 
be achieved in small classes. Moreover, both ^• 
students and faculty members feel that teaching is 
more effective in small classes (p. 26). 
...analysis of research suggests that the importance 
of size depends upon educational goals. In general, 
large class s are simply not as effective as small 
classes for retention of knowledge, critical 
thinking, and attitude change (p. 27). 



Some of the adverse consequences of the rising enrollments are 
discussed by Krabill (1981). He states that the voluminous university 
enrollments following World War II were handled by the acquisition of 
more faculty members. But, this solution is not readily available for 
most institutions today. Instead, he feels it is appropriate for us to 
assess the consequences of increased enrollments by listing them and then 
focusing on possible solutions. The adverse consequences which he 
discusses are the following: 



1. Heavier teaching loads 
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2. Reduced research activity 

3. Tighter operating budgets 

4. Reduced student-faculty contact 

5. Greater use of non-faculty personnel 

6. Fewer requirements and course offerings 

7. Inadequate facilities 

8. More rapid deterioration of facilities and 
equipment 

9. Decreased in-depth student learning 

Kraybill provides no solutions to these problems, but does point out that 
we must know what the problems are before we can attack them. Some 
plausible solutions to several of these problems will be discussed in the 
Results section of the present study. 

Studies on Improving Teaching in Large Classes 

Most of the studies done on improving teaching in large classes have 
compared the "traditional" method (i.e.. lecture) with an "innovative" 
method (e.g., Guided Design, programmed instruction, TV instruction, 
lecture-discussion, etc.) (Baker, 1976; Cheatham & Jordon, 1976; Macomber 
& Siegel, 1957; Siegel, Adams & Macomber, 1960; Ward, 1956). Not 
surprisingly, it is the "innovative" method which is found to be more 
effective (i.e., improves student test scores) for teaching large 
classes. This may be due to the notion that students in large classes 
expect to be lectured to and any deviation from this method engages their 
attention. It is also quite possible that the instructors spend more 
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time preparing the "innovative" method and, thus, it is presented with 
more enthusiasm and polish.- 

Several researchers (Moore, 1977; McKeachie, 1980) have- indicated 
that a variety of teaching methdtis should be used in large classes '\nd 
•that the methods chosen .should be appropriate to the size class being 
taught. -Moore (197>') demonstrated in her study that student negative 
attitudes toward a large class could be changed if the instructor varies 
the method of presentation from class period to class period and 
establishes a set of instructional and student objectives.. NlcKeachie 
(1980) also note^, "Probably of more significance than class size per se 
is its relation to the teaching method used. For example, one would 
expect class size to be of minimal relevance in television teaching, of 
slight importance in lecturing, and of much importance in discussion" 
(pp. 26-27). Research also suggests that the optimum class size depends 
upon the instructor's educational goals. If an instructor is satisfied 
with student? just "getting the facts" then a large class will probably 
present fewer problems to thit instructor. Frustration may occur, 
however, if the instructor wants the students to be able to analyze and 
apply these facts in new situations. 

Wales and Nardi (1981) present four variables which were defined by 
Benjamin Bloom (1980) as means by which instructors can improve their 
teaching, even in crowded classrooms. These fOur variables, are Time, 
Intelligence, Testing, and Personality. Table 2.1 indicates the factors 
of these variables which may be changed to produce more effective 
teaching. It was hypothesized that the appropriate manipulation of these 
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TABLE 2.1 
The Four Bloom Variables 



Not easily Changed 

The time available for 
schooling • 

Student intelligence 



Testing' for grades 



Teacher personality 
characteristics 



TIME 
INTELLIGENCE 



TESTING 
PERSONALITY 



Change is Possible 

The time a student spends 
on a task o.r subject 

Student cognitive entry 
characteristics that 
serve as jase for learn- 
ing new concepts. 

Testing to provide correct 
ive feedback 

The characteristics of the 
teaching: cues, rein- 
forcement, developing 
student participation 



(Wales & Nardi. 1981. p. 336) 
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four variables would positively influence student success. The first 

• t 

variable, TIME, concerns increasing the time a student spends learning 
outside of class. Bloom (1980) states that this time can be dramatically 
increased by improving the quality of the instructional materials (e.g., 
text appropriate to the needs of the student, objectives to guide th*» 
students* study, and handouts which model the skills the instructor 
expects the students to master). The second variable, INTELLIGENCE, 
deals with the cognitive entry characteristics which serve as the. 
foundation for learning new concepts. This means that the instructor 
would focus on helping students develop the cognitive skills they will 
need to successfully master the content of the course (e.g., problem 
solving skills for students in Engineering). The third variable, 
TtSTING, can be used to provide corrective feedback to the students 
instead of using it only to assign grades. If students have this kind of 
frequent feedback. Bloom claims that up to 90 percent of them can be 
successful in a course. The fourth variable, PERSONALITY, can be changed 
if the instructor changes the teaching-learning process. This can be 
done by increasing the cues to important material, providing variety, 
frequency and quality in the reinforcement given to each student, and 
encouraging student participation. Data collected from an engineering 
program at West Virginia University indicates that manipulating these 
variables as indicated above produces very high student performance. In 
their conclusions, Wales i Nardi suggest that "class size may be a 
constraint to accomplishing these ends but it should not Ue a deterrent" 
(p. 340). Large courses taught in this manner require a great deal of 
preparation to develop the initial materials but the outcome seems to 
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be greater student achievement and a more positive attitude toward the 
course and instructor. 

In 1977 Connor reviewed the research evidence on the effectiveness 
of various methods of teaching used at the university level. He 
concluded that the size of the class need not be a major factor in the 
effectiveness of teaching and that the teaching/learning process can be 
individualized and learning can be done independently if the correct 
procedures are used. There is, however, no single instructional method 
which is the most effective for all situations and all subjects. Since 
independence in learning by the student is the ultimate goal of all , 
education, this fact should influence all instructional efforts. 

The utilization of a variety of teaching techniques, geared to the 
size of the class, the content, and the skills of the instructor is 
important to the effectiveness of large class (or really, any size class) 
instruction. Thus, instructors should be assisted in acquiring the 
skills which are necessary to successfully and effectively guide the 
learning of their students. \ 



Studies dealing with the student evaluation of university classes 
and instructors have become increasingly numerous during the past decade 
due to the call for instructor accountability by students, parents, and 
administrators (Haslett, 1976; Marques, 1979; Marsh, 1977; Marsh, Overal 
& Kesler, 1979; Overall, 1977; and Romney, 1976). These studies provide 




Studies Focusing on Student Evaluation of Large Classes and Instructors 
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evidence that the evaluations of students concerning the effectiveness of 
their instructors' teaching are valid. Moreover, in several studies 
cited by Connor (1977) in his review, it was reported that students' 
attitudes toward large classes are not necessarily influenced by the size 
of the class but by the course content and the ability of the instructor 
' to handle large groups. Thus, instructors who enjoy teaching large 
classes and who^ can motivate large groups of students to delve into the 
content on their own should be encouraged' to teach these classes and 
should be provided with 'incentives for doing so. 

Summary of Related Literature 

Though a majority of the university instructors and students believe 
that small classes are superior .to large ones in almost every way, 
research indicates that by utilizing the proper teaching techniques most 
instructional objectives can be accomplished in any size class. The 
larger the class, however, the more time arr instructor must spend on the 
development of a variety of teaching procedures and evaluation 
■ strategies. This fact must be taken into consideration by both the 
instructors and the administration if large classes are going to be 
taught effectively. 
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III. PROCEDURES 

h 

r 

Instrument Development . 

Three Instruments were developed to gather data in this study: The 
Expanded Cognitive Interaction Analysis System, the Student Attitude 
Survey, and the Support Assistance Needs Syrvey. 

The first instrument is an expansion of the Cognitive Interaction 
Analysis Systfem (CIAS) which was developed by Dr. Glenn Ross Johnson 
(1978) at Texas A&M University. His original instrument consists of 10 
categories into which the verbal interactions which occur in a classroom 
may be coded (see Table 3.1). However, a more detailed description of 
the interactions was needed to provide beth a more complete picture to 
the faculty member during consultations and to assist the LCAP staff in 
determining the quality as well as the quantity of the verbal activities 
which took place in the classes being observed. 

As the LCAP Coordinator observed various classes in her role as 
Faculty Development Specialist, she decided tHat the addition of 
subcategories to the original 10-category system would assist the faculty 
members', understanding of the little things which can affect the quality 
of his/her teaching. These subcategories evolved as it was felt^ 
additional information would be useful in the interpretation of spe<J;ific 
interactions. Thus, for example, subcategories for the various level^ of 
questions were added, as were subcategories for the many types of 
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TABLE 3.1 

Cognitive Interaction Analysis System (CIAS)* 



1." Accepting student attitudes . Comments that communicate a 
non-thre^ten1ng acceptance of student attitudes; student 
attitudes may be positive or negative; "You appear to be 
upset about this." "I'm glad to see you all are happy 
about the results from last week's test." 



2. Positive reinforcement . Praising students; communicating 
a definite value Judgment indicating that the instructor 
really likes what the student said or did; "Excel lent 1" 
"Very good!" 



TEACHER 
TALK 



3. Corrective/feedback . Includes negative statements which 
' are nonpunitive and nonthreatening; saying "no" or "yes" 

or "that's correct" in a manner that provides feedback 

to students; repeating a student's response so all students 

know the answer was correct or acceptable. 

4. Questions . Includes rhetorical questionis; all questions 
raised by the teacher; calling on student by name to 
respond to a question. 

5. Lecture. Conmuni eating facts, expressing ideas, giving 
examples. 

0. Provi d1 ng cues/di recti ons . Words that signal Importance; 
"This is important to remember." "These next four items 
are very Important in our study." Directions the instruc- 
tor expects the student's to follow; incl^ides procedural 
directions. 



7, Criticism. Negative, punitive comments; strong criticism; 
ETrmTngs tudents ; saying "Ridiculous" or "That's silly" 
or "Don't Interrupt me when I'm giving my lecture." 



8. Cognitive student talk. Talk by students which is subject- 
' matter oriented; recalling facts; responding to teacher 
questions or directions with subject-matter responses or 
subject-matter questions; expressing opinion or ideas about 
topics under study; analyzing, synthesizing, evaluating; 
subjert-matter questions raised by students. 



STUDENT 
TALK- 



9.. Non-cognitive student talk . Talk by students which'is not 
related to subject matter; management comments by students; 
"Can we leave now?" or "Can we take a break?" or "Will we 
have the quiz tomorrow?'' or "I went to the game Saturday 
and didn't have time to prepare my lesson." 



SILENCE 



0. 



Silence . Three seconds or 
no communication exists. 



more of silence; pauses, when 



*No rating scale ^s Implied; the numerals merely indicate the particular 
category of interaction in use during each three seconds. (Johnson, 1978, 
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activities which would all be considered as "Lecture" in the broad 
10-category system. The final system which evolved consists of the basic 
10 categories with the addition of 35 subcategories (see Table 3.2). 

To calculate the inter -observer reliability of the adapted CIAS, two 
observers were trained in its use using a programmed workbook (see 
Appendix E) and an audio-tape (which were developed for this purpose). 
After approximately 10 hours of training/practice the two observers were 
obtaining reliability agreements of .80 or over. During the summer and 
fall of 1979 this observation. system was tested to determine its 
usefulness in the observation and analysis of large classes. The LCAP • 
Coordinator and one observer coded the verbal interactions in the 
following classes: 2 Chemistry classes, 1 General Studies class, 1 
Radio-TV-Film class, 1 History class, 1 Art History class, and 1 Music 
Appreciation class. It was determined from these observations that the 
Expanded CIAS was definitely a very useful tool for the In-depth analysis 
of classroom interactions in large university classes. For the LCAP 
study two additional observers were trained in CIAS observation and 
analysis techniques. At the end of the one-week training period, these 
observ^ers were obtaining re 11 ability. jagreements of .80 or over between 
themselves '^nd with the two original observers. 

The second instrument *which was developed was a Student Attitude 
Survey (SAS). (See Appendix B.) The LCAP Coor44Trataj::^was assisted in 
.the development and testing of this survey by the Measurement and 
Evaluation Center (MEC). The survey was designed to obtain information 
concerning students' attitudes toward their learning experiences in large 
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TABLE 3.2 



Expanded CIAS Categories 



1 - Accepting Student Attitudes 

Ih - Humor 

2 - Positive Reinforcement 

2f - Affective Instructor Comments 

3 - Repeating a Student Response 

3f - Corrective Feedback 

3b - Building on Student Response 

4 - Questions 

4c - Knowledge/Comprehension 

4e - Application (Examples) 

4a - Analysis 

4y - Synthesis 

4J - Evaluation/ Judgment 

4f - Affective 

4s - Process or Structure 

4r - Rhetorical 

4p - Probing 

4d - Calling on a Student 

5 - Lecture 

5v - Simultaneous Visual and Verbal Presentation 
5e - Examples. Analogies 
5r - Review 

5x - Answering a Student Question 
5m - Mumbling 

5t - Reading from Visual or Text 

6 - Providing Cues 

6m - Focusing on Main Points 

6d - Directions 

6s - Assignments, Process 

7 - Criticism 

8 - Cognitive Student Talk 

8c-8s - Answers to Instructor Questions 
8n - Doesn't Know 
8q - Student Question 
8h - Student Laughter 

9 - Non-cognitive Student Talk 

0 - Silence 

Ob - Writing on Board without Talking 
Om - Mumbling (general low roar) 
01 - Listening/Watching 
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classes in general and their attitudes toward the particular large class 
which was Involved In LCAP. The survey was administered at the beginning 
and end of each semester to determine whether the students' attitudes 
changed over time and after exposure to large classes. This Instrument 
was tested in four large classes during August, 1980. After the data 
from these classes were analyzed, the MEC. and the LCAP Coordinator made 
some final revisions Oh the SAS. Subsequently, the survey was 
administered to over 2500 students during the 1980-81 academic year. 

The last Instrument developed was the Support Assistance Needs 
Survey (see Appendix E). This survey was developed to obtain additional - 
information concerning the support assistance (e.g., TAs, proctors, 
graders, secretaries, funds for duplication, supplies and visual aid 
development, etc.) which faculty members receive or do not receive from 
their respective departments. This survey was sent to 126 faculty 
•members who were teaching large classes during the Spring semester, 1981. 
(This Included those who were Involved In the LCAP study as well as all 
of the other faculty members in the four target colleges who were listed 
in the 12th Day Class Roster as teaching large classes.) Sixty-nine 
faculty members returned the form for a response rate of 55%. 

. Observation and Data Collection Sequence 

In 16 of the 19 LCAP classes the Student Attitude Surveys were 
administered on the first day of class (or as close to the first day as 
possible) and along with the Course/Instructor Survey from MEC at the end 
of the semester. In one class, the survey was only administered along 
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with the Course/Instructor Survey at the end of the semester. The Fall 
Pre-semester survey was administered during the week of September 15-19, 
1980 and the Post-semester survey was administered during the week of 
December 2-5, 1980. The Spring Pre-semester survey was administered 
during the weeks of January 19-23 and 26-30, 1981 and the Post-semester 
survey was administered duing the weeks of Apri : 27- May 1 and May 4-8, 
1981. 

The students were told that this survey was being administered to 
discover what they liked or didn't like about large classes so we, in 
turn, could pass this information on to their instructors and the UT 
administration. They were also told that some of the information would 
be used to develop a "Handbook for Instructors of Large Classes." 

Each LCAP observer attended from 1-4 courses throughout e«ch 
semester. During the first class a descriptive Classroom Observation 
Form was filled out (see Figure 3.1). This form allowed the observer to 
become familiar with the techniques and style of the instructor's 
teaching and to acquaint him/herself with the room and the students^ 
During all subsequent classroom observations the observer used CIAS to 
code what was taking place in the classroom. Each observer attended at 
least one class meeting per week, per course being observed. To ensure 
that each day of the week- the class met was represented in the data, the 
observations were made such that the class was observed on Monday the 
first week, Wednesday the second week, and Friday the third week. .Then 
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FIGURE 3.1 

CENTER FOR TEACHING EFFECTIVENESS 
CLASSROOM OBSERVATION FORM 

THE COURSE. Number: TUlei Meeting t1i 

LEVEL. Freshman Sophomore Junior Senior Graduate 

CLASS. Size: Description of room: ^ 

Where students congregate: 

SUBJECT FOR THE HOUR. . 

METHOD- 

THE INSTRUCTOR. 
Speaking style: 

Use of Movement/ Gestures: 
Use of Media: 

t 

Enthusiasm: 

Handouts: 

THE STUDENTS. 
Attentiveness (beginning vs. end): 

Questions: 

Evidence of Understanding: 
Note taking: 
GENERAL COMMENTS. 
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the cycle began again. Classes which met on Tuesday and Thursday were 
observed Tuesday one week and Thursday the next week. Thus, each class 
was observed at least 13-14 times over the course of the semester. 



/ * 
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IV. SUMMARY, CONCLUSIONS, AND 
RECOMMENDATIONS FOR FURTHER STUDY 



Due to the fact that the volume of data generated in this study are 
so numerous, it was decided that this report would be easier to read and 
would make more sense if the Summary, Conclusions and Recommendations for 
Further Study were placed here rather than at the end. Each portion of 
the data analysis has been summarized in the Summ-iry section an4 page 
numbers for the detailed descriptions which occur in the Analysis and 
Intepretation of the Data section are provided. Th 's, if the reader is 
interested in reading the detailed analysis for a particular section, it 
is referenced and may be located rather quickly. 

Summary 

Though many studies have been conducted on the relationship of class 
size to student achievement, there are few which have looked specifically 
at the types of teaching techniques which can be used in large (100+) 
university classes to make them more enjoyable and effective. The Large 
Class Analysis Project (LCAP) was conducted to gather direct 
observational data concerning the methods and procedures used in teaching 
large classes and to ascertain the attitudes held by students and 
instructors toward the large class teaching/ learning environment. 
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The LCAP study data were collected via ftve methods: (1) the 
Student Attitude Survey, (2) the Direct Observational Data, (3) the 
analysis of each instructor's Evaluation Instruments, (4) the Support . 
Assistance Needs Survey, and (5) the Instructor Interview Data. 

0 

The Student Attitude Survey Data 

The Student Attitude Survey was administered to the students at the 
beginning and end of each senister. The Survey consisted of five 
distinct sections, each of which was analyzed as a separate entity. 

Section I; The Demographic Data (Items 5-8) . The analysis of the 
demographic data indicated that the sample of students (about 2571) who 
were enrolled in the large classes which took part in the LCAP study 
consisted of: (1) 37X Freshmen, 21.5% Sophomores, 23. 5X Juniors, 15.535 
Seniors, and 2* Others; (2) 53X males and 46. 5X females; (3) 22. 5X had 
taken no large classes prior to the LCAP class, 9* had taken one, 10.5% 
had taken two, 10% had taken three, and 46.5% had taken -four or more; and 
(4) 35% of these students were taking the LCAP classes as electives and 
64% of them were taking them as a requirement for their degree programs. 
(For a detailed explanation of these data see p. 39 in the Analysis 
section.) 

Section I: Enjoyment Rating (Item 9). This question provided a 
great deal of information concerning the students' attitudes toward the 
large classes which were being observed for this study. It was found 
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that, overall, the students indicated that they enjoyed their classes 
somewhat less at the end of the semester. ' It was also found that the 
students in the Colleges of Engineering and Business indicated that they 
enjoyed their classes less thari did those in Natural Science or Liberal 
Arts. When these data were analyzed by student classification it was 
found that Sophomores indicated that they enjoyed their large classes 
most while Freshmen, Juniors, and Seniors enioyed theirs least. Also, 

c 

males said they enjoyed these large classes less than did the females. 

Each of the classes was ranked based on the Post-semester ratings on 
Item 9 and this provided the basis for some further analysis. First , it 
was found that of the five (5) top-rated classes, only one was a required 
course. Of the bottom five (5) courses, three (3) were required and two 
(2) were elective. Thus, we can say that students seem to enjoy 
non-required courses more than required courses. Second , the class GPA 
was calculated and it was found that students do not make the highest 
grades in the classes they enjoy the most but they do tend to Inake lower 
grades in those they enjoy least. Third , when the rooms in which the 
LCAP classes were taught were analyzed by the class enjoyment ratings it 
was found that poor or inadequate facilities can be a detriment to 
learning and enjoyment but dynamism and enthusiasm on the instructor's 
part can overcome the problem of poor facilities to some extent. And 
finally , by comparing the direct observation codes with the enjoyment 
ratings of the classes it was found that students most enjoy classes in 
which (1) students are allowed and encouraged to ask questions and (2) 
the instructor provides plenty of positive reinforcement. It was also 
found that students least like classes in which (1) instructors ask a lot 
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of questions or (2) use aud1o*v1sua1 aids a great deal. (For a detailed 
explanation of these data see p. 42 In the Analysis section.) 



Section II: Essentials for Learning (Items 11-19). This portion of 
the SAS yielded information concerning the types of activities and 
materials which the students felt were most Important to their learning. 
The three items which the largest percentage of the students indicated 
were extremely Important to their learning were: 

I^em 12 - Feeling at ease when you talk to the 
in^structor individually. (41%) 

Item 15 - Having the course material and assignments 
we 11 -organized. (55%) 

Item 19 - Having an Instructor who is very 

knowledgeable in the subject. (71%) 

When the items in this section were sorted and analyzed by college it was 
found that the students in Engineering felt that the outside readings and 
the text are more essential to their u'' ^.rstandinq of the content (Item 
18) tharr^^i'd the students in the other three colleges. Some differences 
were also found when the responses to the items in Section II were 
analyzed by sex. Items 12 (feeling at ease when you talk to the 
instructor individually) and 15 (having the course material and 
assignments well-organized) were found to be more important to females in 
their learning than they were to males. (For a detailed explanation of 
thes3 ddt.-x see p. 53 in the Analysis section.) 

Section III: Preferred Class Size (Items 20-24). The students were 
asked to rate five class size ranges from the size they preferred most to 
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that which they preferred least In this section of the SAS. The 
students' responses Indicated that they most prefer classes of from 16-30 
students because they feel more a part of the class and they find this 
environment more conducive to learning. Their responses also Indicated 
that they least prefer classes with over 100 students because (1) they 
get less feedback from the instrctor, (2) they do not feel like 
participating, (3) they feel di^nt from the instructori and (4) they 
thfnk that the course can be taught more efficiently in smaller groups. 
(For a detailed explanation of these data see p. 65 in the Analysis 
section.) ^ 

* 

Section IV; Characteristics of Large Classes (Items 25-41). Many 
statemerts have been made about the pros and cons of the large class 
teaching /I earning environment. In this section the student; were asked 
to react statements about things which have been said to happen when 
c'lasses increase in size. Their responses were on a scale fr^^m 1 
(disagree strongly) to 5 (agree strongly). Their responses to these 
statements indicate that they feel the qulity of instruction in large 
classes is definitely determined by the instructor. Because if this the 
students believe that instructors who enjoy teaching and are truly 
concerned about the progress of their students make better large class 
instructors. The discipline (or lack of it) in large classes is also a 
concern of these students. Instructors who put up with noise, 
late-comers, talking during class, and cheating are not considered to be 
effective. In addition, ^-hese students indicated that though they do not 
rate large classes highly, they feel these classes can be improved if the 
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instructors are trained In effective teaching techniques. . (For a 
detailed explanation of these data see p.76 In the Analysis section.) 

The Direct Observation Data 

One of the main goals of the LCAP study was to compile objecl^ive 
data on the teaching strategies used in large class Instruction. This 
was accomplished through the use of the Cognitive Interaction Analysis 
System with which the verbal Interactions which occurred In the classrpm 
were recorded. As was expected, the bulk of the class time was spent in 
the Instructors lecturing (with and without the aid rf visuals). The 
interactions which occurred least frequently were "Instructor use of 
criticism" and "non-cognitive student talk." On the average, the 
instructors spent 88. 5X of the class time talking while the students only 
talked an average of 5.02% of the time. Periods of silence involved an 
average of 6.36< of the class time. It was also found that as the 
average class size decreases, t'-" amount of student participation 
increases (from 1,1% of the time In the largest classes to 6.9X of the 
time in the smallest classes). 

Several trends were noted when a comparison of the mean percentages 
of use (from the first and second half of the semester) for each of the 
14 CIAS categories for each Instructor were analyzed. Most of the 
Instructors increased the use of Categories 1 (Accepting student 
attitudes), 2 (Positive reinforcement), 13 (Student asked questions), 10 
(Silence), and 9 (Non-cognitive student talk) In their classrooms. On 
the other hand, decreases were found in their use of Categories 3 
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(Repeating a student response, providing corrective feedback), 11 
(Humor), 8 (Cognitive student response), and 6 (Providing cues, giving 
directions). The use of Categories 4 (Instructor asked questions), 14 
(Writing on board or overhead without talking), 5 (Lecture), 12 
. (Simultaneous use of visual and verbal presentation.) and 7 (Criticism) 

V 

remained constant over the semester. 



When comparing the verbal Interactions In lower-division vs. 
upper-division courses. It was found that lower-division instructors seem 
to be more student-oriented In that they use the following types of 
statements significantly more than do upper-division Instructors: 

Category 3 (Repeating student response; providing 

corrective feedback; building on a student 
response) 

Category 4 (Asking questions) 

Category 6 (Providing cues; focusing on main points; 

giving directions; assignments, process) 

Category 12 (Simultaneous visual and verbal 
presentation) 

Category 14 (Writing on board without talking) 

(For a detailed explanation of these data see p. 99 In the Analysis 

section.) * • 



Cognitive Levels of Instructors' Evaluative Instruments 



Each Instructor who participated In the LCAP study was asked to 
provide copies of his/her^ exams, quizzes, homework assignments, and 
written assignments to Ije analyzed. E?ch item on these exams, etc. was 
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examined and classified according to Oloom's Taxonomy of the Cognitive 
Domain. An overall percencage of each cognitiVv; level required was then 
calculated for each Instrument. It was founr that the instructors 1n the 
College of liberal Arts used the widest range of cognitive levels In 
their evaluative Instruments and the lowest range was found in Business 
and Engineering. 

The cognitive levels found in each instructor's evaluative 
instruments were then compared with the instructor's ranking on Item 9 on 
tb^ SAS. From this comparison It was found that the Instructors whose 
evaluation Instruments required that the students use analysis-, 
synthesis-, ^nd/or evaluation-level thinking processes were rated in the 
top half of the enjoyment rankings. The Implication Is that students who 
are challenged to use higher-level cognitive processes enjoy their 
courses more. (For a detailed explanaton of these data see p. 164 In the 
Analsis section.) 

Support Assistance Needs Survey Data 

This* survey was designed to acquire information concerning the 
adequacy of the support assistance which Is or 1s not provided to 
instructors who teach large classes. The three major needs which were 
cited by the Instructors who returned the survey are: TA/grader 
assistance Is needed to test properly in these large classes; (2) 
additional funds need to be allocated to provide and maintain 
AV-equipment; and (3) the need for more comfortable/functional rooms In 
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which to teach these large classes. (For a detailed explanation of these 
data see p. 192 in the Analysis section.) 

Instructor Interview Data ' 

A total of 43 instructors who teach large classes were interviewed 
by a member of the LCAP starf to acquire first-hand information about 
some of the joys and frustrations of teaching large classes. The main 
concern of these instructors in teaching such large classes is the lack 
of personal contact with their students. Most feel that they really 
cannot adequately evaluate their students' understanding of the content 
because they frequently do not know who their students are. However, 
many of the instructors suggested ways which they have found useful in 
trying to personalize this mass instructional mode. 

When asked what their main goals were for their students, most of 
the instructors stated goals which would be classified at the 
knowledge/comprehension level of Bloom's TaxpnorDy. On the averaige, these 
instructors gave between 3 and 4 exams during the semester and these 
exams consisted primarily of multiple-choice questions. They were 
unanimous in their feelings that giving and grading exams are the worst 
part of teaching large classes. 

Of the 43 instructors interviewed, 59. 5X stated that they would 
prefer to teach classes of from 1-50 students. More of the instructors 
in Liberal Arts and Business prefer larger classes than do those in 
Natural Science or Engineering. 
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When asked, "What are the characteristics of good large class 
instructors?", they listed the following qualities: 

1. They care about their students. 

2. They take their students very seriously and let 
them know that they take their teaching very 
seriously. 

3. They maintain eye-contact with the class. 

4. They are enthusiastic about their subject. 

5. They have to be a performer with a persona that 
is somewhat different from the one they are from 
day to day. 

6. They have confidence in themselves and what they 
are doing. 

Suggestions for the novice large class instructor were also 
solicited during these interviews, as well as recommendations to the 
administration on how to improve the quality of teaching/ learning in 
large classes on the UT-Austin campus. (For a detailed explanation of 
these data see p. 198 in the Analysis section.) 

Conclusions 

Based on the data gathered in the Large Class Analysis Project the 
following can be concluded about current teaching practice^ in large 
university classes and suggestions for improvement: 

V 

1. Neither the students nor the instuctors particularly 
like classes with more than 50 students in them. 
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> 2. Large classes can be taught effectively if: 

a. the facilities are comfortable and designed for 
teaching/learning. 

b. the Instructors are taught effective teaching 
strategies and techniques. 

c. the media support is available and is maintained. 

d. the instructors are given adequate TA/grader and 
monetary support. 

e. instructors who enjoy teaching and who like 
students are asked to teach these classes. 

f. the instructors set down strict guidelines for 
student behavior in Class. 

3. A majority of the large class instructors use 
multiple-Choice exams and test only at the knowledge, 
comprehension, and/or application levels. 

4. Students enjoy large classes more in which they are 
tested at higher cognitive levels (i.e., essy exams). 

5. Student participation increases as the Sjize of the 
class decreases. 

6. The characteristics of an effective large class 
instructor are: 

a. Enthusiasm about subject. 

b. Knowledge of the subject and the ability to 
communicate this knowledge. 

c. Cares about the progress and welfare of the 
students. 

d. Dares to discipline (govern) to eliminate 
unnecessary talking, etc. 

e. Has a sense of humor. 

f. Uses a variety of instructional strategies. 

g. Interac+s with t^e students during, as well as 
before and after class. 

h. Has confic'ence in him/herself and what he/she is 
doing. 
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7, Instructors lecture 85X-90X of each class period while 
students participate during about 5% of each class 
period. 

8. Students Indicate that they can learn more In a large 
class If: 

a. they feel at ease when they talk to the Instructor 
individually. 

b. the Instructor Is very knowledgeable in the 
subject. 

c. the course material and assignments are 
well -organized. 



Recommendations for Further Study 



Though the Large class Analysis Project has provided a weath of data 
concerning the teaching/learning environment in large classes, there are 

t 

still several recommendations which should be made for future study of 
this environment. 



1. It would be very useful to conduct a similar study of 
smaller classes taught by the same people who taught 
the LCAP classes to determine exactly what these 
instructors do differently In a small class (I.e., 
what Is the % of Teacher Talk vs. the % of Student 
Talk in the smaller classes). This would assist 
researchers In determining if any of the techniques 
used more frequently In small classes could be 
transfered to larger classes. 

2. Further examination of the cognltve levels of exams 
and written work given In large classes is In order to 
discern the support assistance which is necessary In 
order to test the students at higher cognitive levels 
using something other than multiple-choice questions. 

3. It would be very useful to study the level of 
knowledge retai 3d about a subject by students In 
large classes who were tested via essay exams versus 
those who were tested via multiple-choice exams. 
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4. To determine whether the findings of this stuiv 
concerning how to Improve teaching/ learning In Wge 
classes are valid, It would be useful to: (1) tratn a 
group of larae class Instructors In teaching \ 
techniques, (2) provide this group of Instructors w1\h 
adequate support assistance (monetary and personnel), \ 
and (3) provide a pleasant, colorful, functional 
teaching evironment for the purpose of studying, the 
effects of these changes on the teaching/ learning 
which occurs. 



Because It appears that large classes are going to be a part of the 
teaching and learning environment in larger universities for some time, 
1t Is essential that ways be found to make these classes more productive 
(In terms of student learning) and enjoyable. The future leaders of the 
world are currently being educated In many of these large classes and 
what they learn or do not learn will affect the future of mankind. Thus 
It behooves us to create an environment 1n which favorable attitudes 
toward learning are formed as well as providing for the optimum 
acquisition oV knowledge. 
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V. ANALYSIS AND INTERPRFJATION OF THE DATA' 

r 

t 

This study has produced a vast amount of data, the analysis of which 
has answered many of the quest*>ns we had hoped to' answer as well a;s 
raised many additional questions about the teaching of large classes. 
The results ^of our analysis and our interpretation of the significance of" 
those results will be discussed. The discussion has been divided into 
four sections: (1) the Student Attitude Survey Data, (2) the direct 
observations, (3) the Support Assistance Needs Survey, and (4) instructor 
attitudes, suggestions, and comments. 

A Word of Caution Concerning Interpretation of the Data 

When doing research in the area of human behavior it is well known 
that dramatic results or large between-group differences with small 
within-group variances are difficult to obtain. The vast number of 
external influences on the subjects tend to obscure the effects of the 
treatment thus making it difficult to interpret the results of the 
research. The results which are "reported here are no exception. 

There are very few times when the mean scores deviate far from 3 (no 
opinion) dn a 5-point Likert Scale. The main thing to consider in 
interpreting the results is the direction and degree of the change. For 
example, if the means for several groups of respondents show a change in 

« 

the same direction, that may indicate an outside variable is influencing 
the change even if the individual changes are not large. Also, if the 
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attitudes Indicated by the means shift from one side of 3 (no opinion) to 
the otherl. that shift Is more meaningful. For example, if a group's mean 
shifts from 2 (disagree moderately) to 4 (agree moderately) the general 
dtsposition of their opinion has definitely changed while a shift from 4 
(agree moderately) to 5 (agree strongly) .does not indicate as strong a 
"value" shift. 

In reporting results of tests of statistical significance, .this 
report considers alphas of 0.01 or less to be significant. Even with 
that strict level the results show some statistically significant 
differences. However, the "real" differences- are fewer In number because 
the statistical significance is a function of sample size rather, than any 
real change in the students attitudes. The results which attain 
statistical significance are reported because they indicate that 
something other than chance Is probably affecting those changes; however, 
the reader should primarily consider the practical significance of the 
results. Small diff.Tences in attitude between the Pre- and 
Post-semester means can probably be accounted for in the change in the 
number of students who filled out the attitude survey. Because of the 
external influences faced in this type of study, the researcher can only 
report the results and provide his/her own interpretation of them; it is 
then up to the reader to determine their practical significnce to his/her 
own situation. 
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Student Attitude Survey Data 



The Student Attitude Survey (SAS) which was developed for this study 
is divided into five sections (see sample in Appendix B). Section I 
(Item 5-9) asked for demographic data and also contains a question (Item 
9) concerning the students' attitudes toward the particular class in 
which the survey was conducted. Section II {'^'lem 11-19) asked' the 
students to rate the given statements based on their importance in ^ 
helping them learn. They were to rate the statements from l^(not 
important at all) to 5 (extremely important). In Section III (Items 
20-24) the students were aski to rank the given class sizes in order of 
their preference (#1 = most preferred class size, #5 « least preferred 
class size). Section IV (Items 25-41) contains statements which are made 
about the pros and cons of large versus small classes. The students were 
asked to react to these statements using a 5-point scale ranging from 1 
(disagree strongly) to 5 (agree strongly). And, Section V provides the 
students with the opportunity to include any additional written comments 
they had about large versus small classes. 

Section I: The Demographic Data (Items 5-81 

The data gathered with this portion of the SAS provided basic 
information about the make-up of the students being surveyed and was also 
a means for more in-depth analysis of the rest of the survey. 
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Overall percentages. The overa IT percentages of student responses 
to these Items is given in Table 5.1. This tells us that, overall, 37% 
of the student respondents were freshmen. It also shows that 53% of them 
were male. Even though many of the students were freshmen, 46. 5X of the 
respondents had attended four or more large classes prior to the one \n 
the LCAP study. Finally, for 64% of the students the LCAP course they 
were enrolled in was being taken as a requirement for their degree 
program. 

By college. The means for Items 5-8 were computed by college to 
determine the typical population for the classes which were represented 
in the study. This information is given in Table 5.2. 

As can be seen from this information, the sample of students from 
Natural Sciences were primarily sophomores (2.2), half males and half 
females (1.5), who had taken from 2-3 large classes prior to that LCAP 
class (3.45). Half these classes were required and half were being taken 
as electives (1*5). 

In the College of Engineering, the students were primarily freshmen 
(1.35f and more were males than females (1.1). These students nad 
previously been exposed to from 2-3 large classes (3.6) and most of these 
students were fulfilling a requirement (1.95) by taking the LCAP course. 

The sample of students from the College of Business was made up 
primarily of juniors (3.4), half male and half female (1.5), who had 
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TABIE 5.1 
Overall % responses to Items 5-8 



1 2 3 4 5 

37* 21.5 23.5 15.5 2 

53* 46.5 

22.5 9 ■ 10.5 10 46.5* 
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* 



*Highest % response for that item. 



TABLE 5.2 

Response Means by College for Items 5-8 







NS 


E 


B 


LA 


AVG • 


5 - 


Year 


2.2 • 


1.35 


3.4 


2.25 


2.3 


6 - 


Sex 


1.5 


1.1 


1.5 


1.5 


1.4 ' 


7 - 


# Ig. cl. 


3.45 


3.5 


4.65 


3.9 


3.9 


8 - 


Required 


1.5 


1.95 


1.75 

c 


1.75 

1 


1.7 



The- number of classes represented from each college are: Natural Science 
(NS) = 3; Engineering (E) = 2; Business (B) = 5; and Liberal Arts (LA) = 7. 

i 
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previously taken 3-4+ large classes (4.65). Fj)r most of these students 
the LCAP course was a requirement for their major (1.75). 

Finally, the sample from Liberal Arts was made up mostly of freshmen 
and sophomores (2.25). half male and half female (1.5). Most of these 
Students had attended 2-3 large classes (3-9) prior to the LCAP class. 
These students were taking the courses participating in LCAP primarily as 
a requirement for their degree program (1.8). 

Section I; Enjoyment Rating (Item 9) 

The wording on Item 9 was changed slightly on the Pre- and 
Post-semester surveys to assist us in determining whether the students' 
attitudes about that particular class changed over time. On the 
Pre-semester survey the students were asked "Do you think you are going 
to enjoy attending this class?" and on the Post-semester survey they were 
asked "How did you enjoy attending this' class?" Both versions of the 
question were to be responded to on a scale of 1 (yes. very much) to 5 
(no. not at all). 

This question was analyzed by overall percentages, and then the 
means of the responses were calculated by college, by instructor, by 
classification, and by sex. 

■\. 

Overall percentages. When the overall percentage of students' 
responses is looked at (see Table 5.3) there is a slight shift in the 




TABLE 5.3 



Percent of Students Responding to Each 
Degree of Scale on SAS Item 9. 



Pre-semester Post-semester 
12345 12345 
9 Enjoyment 21 33 33 9 3 22 31 25 14 7 



43 



57 



Pre- to Post-semester responses toward enjoying the classes less at the 
end of the semester. 

By college. The shift which was seen in the overall percfentages is 
evident again when the Pre- and Post-semester means for each college are 
analyzed, (Table 5.4). This comparison shows that the students in the 
Colleges of Engineering and Business enjoyed their classes less by the 
end of the semester while, those in Natural Science and Liberal Arts 
remained fairly constant, in their evaluation. These data also show that 
the students in Business appear to- enjoy their classes less than do the 
students in the other three colleges and they also expect to enjoy them 
less. 

By classification. When the means for Item 9 are calculated by 
student classification we can see that the Freshmen and Juniors changed 
their minds about the classes they attended while the Sophomores, 
Seniors, and others did not (Table 5.5). On the Post-semester survey, 
the Sophomores indicated that they enjoyed their classes the most while 
the Freshmen, Juniors and Seniors enjoyed theirs least. 

By sex. The means for Item 9 were also calculated by sex (Table 
5.6). Though there was no significant difference between the means for 
males and females in the Pre-semester data we can note that the males 
indicated that they enjoyed their classes less in the Post-semester 
survey than did the females. 
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TABLE 6.4 

Pre- and Post-semester SAS means by College for Item 9. 

a 

NS E B LA AVG Rvalue p df 

9-Enjoyment pre 2.2 2.2 2.6 2.4 2.4 17.74 .0000 3,2448 

post 2.3 2.6 2.9 2.4 2.5 26.463 .0000 3,2020 

NS-Natural Science, E-Engineering, B-3usiness, LA-Liberal Arts 

TABLE 5.5 

Pre- and Post-semester SAS means by Student 
Classification for Item 9. 



Fr So Jr Sr 0 Fvalue p df 

9-Enjoyment pre 2.3 2.3 2.4 2.6 2.4 6.692 .OCOO 4,2410 

post 2.6 2.3 2.6 2.6 2.4 5.246 .0003 4,1934 

Fr-Freshmen, So-Sophomores, Jr-Juniors, Sr-Seniors, 0-Others 

TABLE 5.6 

Pre- and Post-seme^^ter SAS Means by Sex 
for Item 9. 

M F Fvalue p df 

9-Enjoyment pre 2.4 2.4 2.574 .1089 1,2417 

post 2.6 2.5 4.903 .0270 1,1941 
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By Instructor, Finally, the means were calculated by instructor (or 
class) (Table 5.7). This comparison Indicates that for all of the 
Instructors except #25 the students enjoyed the class less at the end of 
the semester. Those In class #25 enjoyed it more. The students in 
instructor #16 's class showed the most variation between the PVe- and 
Post-semester surveys (3.1-pre, 4.1-post, 1.0-varlation) . 

Three of the questions which we had hoped to answer in this study 

were: 

1) whether students enjoy their classes more If they were taken as 
elect Ives; 

2) whether the students made higher grades in the classes they 
enjoyed the most; and 

3) whether the room/facilities Influenced their enjoyment of the 
class. " / 

I 

I 

To answer these questions the Post-semester means for I^em 9 were ranked 
from the course students enjoyed most to the one they enjoyed least. 
These rankings along with seme additional information are given in Table 
5.8. 

Required vs Elective. First, of the five top-rated classes as seen 
in Table 5.8, (based on the Post-semester ratings on Item 9), only one 
was a required course. Of the five bottom-rated courses, three (3) were 
required and two (2) were elective. This leads us to answer the first 
question affirmatively: Yes, students enjoy non-required courses more 
than required courses. 
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TABLE 5.7 

Pre- and Post-semester SAS Means by Instructor for Item 9 



NS 



B 



LA 



Instructor Code 

Item 9 Pre 
Post 



11 


12 


15 


13 


29 


11 


11 


21 


22 


26 


16* 


20 


23 


24 


25* 


27 


28 


1.9 
2.2 


2.1 
2.2 


2.7 
2.6 


1.7 
2.4 


2.5 
2.9 


2.8 

3.3 


2.0 
2.7 


3.0 
3.1 


2.5 
2.7 


2.4 

M 


3.1 

M 


2.2 
2.3 


3.3 
3.3 


2.0 


2.8 
2.0 


1.8 

ITT 


1.3 
1.4 



16* Most variation between pre- and post-semester surveys. 

25* Change Indicates more enjoyment at end of semester than at beginning. 

Underlined means indicate at least a .3 change between pre- and post-semester SAS means. 
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TABLE 5.8 

SAS Mpans for Q9 (Enjoyed Class)* By Instructor 



Mean 


Type 
Class** 


Required? 


Days 
Held 


College 


Room 


Students 


A 


% Given 
B C D/.F 


Cr 


Avg 
GPn 


Instr. 
Code 


1. 1.3548 


U 


N 


TTh 


LA 


GAR 


1 


130 


20 


35 


26 


5 


6 


2.74 


28 


^.uuuu 


U 


N 




1 A 

LA 


DAT 
□AT 


/ 


onn 


Q 
O 


OO 




1 1 
11 


O/l 
CH 


O OO 


0/1 
CH 




1 

L 


n 
K 


MWr 


1 A 

LA 


O AO 


1 
1 


oort 
ecu 


07 


A 0 
Ho 


lb 


o 

O 




o on 


or 
cXt 


A 9 11 


U 


hi 


1 1 n 


1 A 

LA 


GOL 


105 


yu 


on 


23 


26 


13 


n 

y 


o i: 1 
^ .bl 


07 

cl 




1 

L 


N 


TTh 

1 1 n 


Mo 


WEL 


3.502 


onn 


1 Q 


29 


35 


14 


1 

1 


0 Af\ 


1 0 

ic 


6. 2.2110 


u 


N 


MWF 


NS 


GEA 


105 


140 


26 


43 


16 


5 


9 


2.87 


11 


7. 2.2281 


L 


R 


MWF 


LA 


BUR 


106 


300 


10 


30 


31 


21 




2.17 


20 


8. 2J826 


L 


R 


TTh 


E 


WRW 


102 


140 


10 


30 


28 


29 


- 


2.01 


13 


9. 2.5739 


U 


R 


MWF 


NS 


Dl II 


VI 1 no 


130 


18 


01 
CI 


on 


07 


1 


2.18 


15 


10, 2,7059 


U 


N 


TTh 


B 


PM A 

LMA 


AO ^on 


140 


13 


OH 


CO 


Q 
J 




2.78 


17 


11 0 7 1 1 '1 


u 


n 
K 


1 1 n 


D 
D 


JES 
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36 


23 


5 


1 




99 


1^. d.,OC^J0 


1 

L 
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t 


WEL 


2.224 


ocr 




32 


17 


14 


1 


0 lA 


9a 


13. 2.8356 


u 


N 


MWF 


B 


FDB 


104 


no 


13 


28 


31 


11 


3 


2.47 


26 


14. 2.9914 


u 


R 


TTh 


B 


WEL 


2.224 


200 


9 


36 


31 


15 


3 


2.37 


21 


15. 3.2658 


u 


N 


TTh 


B 


GSB 


1.216 


120 


12 


31 


36 


13 


3 


2.39 


14 


16. 3.3016 


L 


R 


TTh 


LA 


BEB 


166 


120 


6 


12 


22 


^^4 


2 


1.47+ 


23 


17. 4.0561 


L 


R 


TTh 


LA 


BEB 


151 


130 


10 


12 


33 


38 


1 


1.83 


16 


18. 


U 


R 


MWF 


NS 


WEL 


2.224 


300 


13 


19 


31 


18 


1 


2.23 


18 


19 


L 


R 


MWF 


U6 


WEL 


2.224 


300 


8 


28 


37 


16 




2.23 


19 



*Q9 - How did you enjoy attending this class? **U = Upper division - Jr. /Sr. Highest and low- 

/jct CPA 

Yes, very much No, not at all L = Lower division - Fr./Soph. 

1 2 3 4 5 
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GPA vs Enjoyment. The second question, whether students made higher 
grades in those classes they enjoy most, would have to be answered 
negatively based on the information in Table 5.8. (The Grade Point 
Average for each class wa:i calculated on a four-point scale where A=4 and 
F»0. The class GPA is the mean of the final grr'as given in each 
particular class.) The class in which the highest class GPA (2.95) was 
given was ranked eleventh, the class with the second highest GPA (2.90) 
was ranked third, and the class with the third highest GPA (2.87) was 
ranked sixth. On the other hand, the class in which the lowest GPA 
(1.47) was given was ranked 16th and the one with the next-to- lowest GPA 
(1.83) was ranked 17th. We cannot say from this information, however, 
that students rank classes lowest in which they get the lowest grades, 
because the cla ;s with the third lowest GPA (2.01) was ranked eighth and 
the class which was ranked #2 in enjoyment had a lower GPA (2.32) than 
did the class which was ranked #15. Thus, there seems to be little or no 
correlation between a student's earned grade and whether or not he/she 
enjoys a class. 

« 

Facilities vs Enjoyment. Of the five top-rated classes, only one 
was taught in what is considered by students and instructors to be an 
excellent room (WEL 3.502). (This information was obtained through 
formal and informal interviews with students and instructors.) We feel 
that this demonstrates that the instructor can and does mak** a difference 
in the students' enjoyment and learning in a class. On the other hand, 
poor facilities can also be a detriment to learning and enjoyment. This 
can be seen in the two lowest-ranked classes. Thesd courses were taught 
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In what many Instructors and students believe to be the two worst rooms 
on the UT-Austin campus. Several instructors who taught two sections of 
the same course, one in BEB 151 or 166 and the other in one of the GSB 
auditoriums, conwented that the student evaluations on the 
Course/Instructor Survey from the Measurement & Evaluation Center were 
10% lower from the students in BEB 151 or 166. Thus, dynamism and 
enthusiasm on the instructor's part can overcome the problem of poor 
facilities to some extent, but a poor room can also deter learning and 
stifle enjoyment. 

Tntor.rtinns vs En.ioyment. The ratings of the classes on Item 9 
were also compared to the types of interactions which were coded by the 
LCAP observers (see Table 5.9). The correlations derived from^this 
comparison showed some surprising results. For the correlation* results 
to reflect a desired relationship, the r value must be negative (i.e.. 
the more frequently an instructor uses a particular type statement the 
more students enjoy the course.) The enjoyment ratings ranged from 1 
(enjoyed a lot) to 5 (did not enjoy). Thus, the data indicate that 
students say they most enjoy classes in which: 

a. the instructor uses a lot of reinforcement 
(Category 2) r * -.3215. and 

b. there are a large number of student-asked 
questions (Category 13) r = -.3233. 

On the other hand, these calculations also indicate that students say 
they enjoy classes less (i.e.. the r value is positive) if the 
instructor: 
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TABLE 5.9 

Pearson Product Moment Correlation Coefficients 
for CIAS Categories and Item §9 



Category 


r 




1 


Accepting student attitudes 


,0013 


.498 


*2. 


Reinforcement 


-.3215 


.104 


3. 


Corrective feedback 


.1779 


.247 


A4. 


Questions 


.4637 


.030 


5. 


Lecture 


-.1832 


.241 


6. 


Providing cues/directions 


-.1125 


'.334 


• 7. 


Criticism 


-.0401 


.439 


8. 


Cognitive student talk 


-.0151 


.477 


9. 


Non-cognitive student talk 


-.0249 


.462 


10. 


Silence 


-.2916 


.128 


11. 


Use of humor 


-.2910 


.129 


A12. 


Lecturing with visuals 


.3334 


.096 


*13. 


Student questions 


-.3233 


' .103 


14. 


Writing on board or overhead 


-.1575 


.273 



r = correlation coefficient 
p = probability 

♦Interactions students prefer most in large cla'sses. 
^Interactions students prefer least in large classes. 
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a. asks a lot of questions (Category 4) r » .4637, 
and 

b. lectures with the aid of visuals (Category 12) r 
« .3334. 

As one would expect, students seem to enjoy classes in which the 
instructors are generous in their use of praise or reinforcement. They 
also seem to enjoy participating in class if their participation is 
self-activated. However, it seems they do not like to be put .on-the-spot 
by instructors who ask them questions. 

i 

It was totally unexpecteij to discover that the students stated they 
dislike classes in which the instructors used visuals to enhance the 
lectures. It is difficult to ascertain from these data whether this 
dislike occurs because the instructors mis-use visuals (e.g., don't 
provide ample time for the students to copy what is written or drawn, put 
too much information on each transparency, or turn all of the lights out 
- making it impossible to take notes) or because the students have 
difficulty seeing the visual aid if they sit in the back of the room, 
this finding is clso puzzling because much of the research indicates that 
students retain more if instructors use visual aids to point out key 
concepts, define words, show illustrative material, etc. (Antioch 
College, 1960; Chance, 1961). Perhaps this indicates a need to educate 
instructors in the correct methods and skills needed to use 
transparencies or slides effectively in their teaching. 




Section II: Essentials for Learn ing (Items 11-19) 

This portion ot the Student Attitude Survey was designed to obtain 
information about the types of activities and materials which the 
stiidents feel are most important in their acquisition of the necessary 
skills and content for their courses. They were asked to respond to 
these items using the following scale:- 

. 1 - not important at all 

2 - somewhat important 

• 3 - moderately important 

4 - quite important 

5 - extremely important 

Overall percent . The overall percentage of students responding with 
each option to Items 11-19 is given in Table 5.10. As can be seen, the 
items which the students felt were most important to their learning 
(i.e., those with the highest response percentage in column 5) were: 



Item 12 - Feeling at ease when you talk to the instructor 
individually (48*, 41%)* 

Item 15 - Having the course material and assignments well-organized 
(61%, 55%) 

Item 19 • Having an instructor who is very knowledgeable in the 
subject (75%, 71%). 



*(pre-semester % choosing option 5, post-semester % choosing option 5) 
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TABLE 5.10 

Overall % of Students Responding with each 
Option to SAS Items 11-19 











Pre 










Post 










1 


2 


3 


4 


5 


1 


2 


3 


4 


5 






NI 


SI 


MI 


QI 


EI 


NI 


SI 


MI 


QI 


EI 


Item 11 - 


topics aimed 


2 


9 


23 


40* 


26 


2 


10 


23 


38* 


27 


Item 12 - 


feel ina at ease 


2 


6 


12 


31 


48* 


4 


5 


14 


36 


4V 


Item 13 - 


chal 1 enaed 


2 


8 


28 


41* 


21 


3 


9 


27 


42* 


20 


Item 14 - 


control pace 


4 


15 


31 


33* 


18 


4 


14 


' 34* 


52 


15 


Item 15 - 


organization 


2 


L 


c 
0 


Ci 


0 1^ 


0 


O 

0 


7 






Item 16 - 


participation 


7 


18 


32* 


26 


16 


7 


18 


32* 


29 


14 


Item 17 - 


feedback 


2 


6 


21 


39* 


32 


3 


6 


18 


40* 


32 


Item 18 - 


outside material 


4 


12 


26 


32* 


26 


5 


12 


26 


32* 


24 


Item 19- 


inst. knowledge 


2 


1 


3 


18 


75* 


3 


1 


4 


21 


7V 



*Highest response percentage for that item. 

NI - Not important at all 
SI - Somewhat important 
MI - Moderately important 
QI - Quite important 
EI - Extremely important 
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?earson Correlation . When a Pearson Product Correlation Coefficient 
was calctilated on the items in this section on the Post-semester data, it 
was'found that Iteni-12 (Feeling. at ease when you talk to the instructor 
individually) correlated highly (.36 - .48) with several other items. • 
Thus, students will feel mord at ease talking individually to an 
instructor if he/she has done the following: 

a. geared the course toward the students' interest 
(Iterii 11) r « .36; 

- b. challenged the students to think for themselves 
(Item 13) r « .38i 

c. organized the t j. ae well (Item 15) r - .48; 

d. welcomed the students' participation (Item 16) r 
= .36^ 

e. provided frequent feedback on the students' 
performance (Item 17) r - .41; and, 

f. conveyed to the students his/her consummate 
knowledge of the subject (Item 19) r = .46. 

m 

In other words, if the instructor shows a definite concern for the 
students and their needs then the students will respond to this concern. 

By college . The response means for each item in Section II were 
calculated for each college represented in the study. These means along 
with the test for significant differences between th^ means of the 
colleges can be seen' in Table 5.11. 

In studying thes? data we see that there is a significant difference 
(p = .0002) between the means for the colleges on Item 18 (Having strong 
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TABLE 5.11 

One-way ANOVA of Pre- and Post-Semester SAS Means by College 

for Items 11-19 









NS 




B 


LA 


Fvalue 




it 


Item 


11 


Pre 

P(,St 


3.7 
3.7 


3.8 
3.8 


3.9 
3.9 


3.3 
3.8 


1 .854 
1.910 


.1357 
.1263 


3,2451 
3,2029 . 


Item 


12 


Pre 
Post 


4.2 
4.1 


4.1 
4.0 


4.1 
4.0 


4.2 
4.1 


1 .986 
?.961 


.1144 
.0314 

i 


3,2452 
3,2027 


Item 


13 


Pre 
Post 


3.6 
3.8 


3.8 
3.7 


3.7 
3.6 


3.7 / 
3.7/ 


^ MAP 

3.445 
1.512 


.0163 
.2098 


O O il CI 

3,2451 
3,2033 


Item 


14 


Pre 
. Post 


3.4 
3.3 


3.6 
3.4 


3.4 
3.4 


.3.5 
3.4 


2.135 
1.222 


.094^ 
.3003 


3,2451 
3,2042 

• 


Item 


15 


Pre 
Post 


4.5 
4.4 


4.1 

M 


4.5 
4.3 


4.5 
4.3 


.703 
.953 


.5502 
.4142 


3,2454 
3,2043 


Item 


16 


Pre 
Post 


3.3 
3.1 


3.3 
3.4 


3.2 
3.2 


3.3 
3.3 


.984 
3.186 


.3994 
.0231 


3,2405 
3,1939 


Item 


17 


Pre . 
Post 


3.9 
4.0 


4.0 
4.1 


4.0 
3.9 


. 3.9 
3.8 


3.514 
4.698 


.0148 
.0029 


3,2456 
3,2041 


Item 


18 


*Pre 
. *Post 


3.6 
3.7 


3.9 
3.8 


3.6 
3.5 


3.6 
3.5 


6.631 
7.99^ 


.0002 
>.0001 


3,2450 
•3,2039 


Item 


19 


Pre 
Post 


4.6 
4.6 


4.7 
4.6 


4.6 
4.5 


4.7 
4.6 


.494 
3.733 


.6867 
.0110 


3,2440 
3,2028 



♦Significant at p - .001. 

NS (Natural Science), E (Engineering), B (Business), LA (Liberal Arts) 

Scale: 1 (not important at all), 2 (somewhat important), 3 (moderately 
important), 4 (quite important), 5 (extremely important). 

Underlined # indicate at least .3 difference between Pre- and Post-Semester 
Means. 
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outside support material, like the text and supplementary readings) both 
in the Pre- and Post-semester data. It seems that the students in 
Engineering find the outside readings and the text to be more essential 
to their understanding of the content than do the students in the other 3 
colleges. One may speculate that this may be because there is a greater 
proportion of foVeign students enrolled in this college and/or that the 
complexity of the material requires more thorough explanations which can 
only be acquired through these sources. There are no significant 
differences among the colleges on the other items in this secton. 

An interesting and somewhat puzzling outcome was the students' 
response to Item 16 (Being able to actively participate in class). This 
item was rated overall as only moderately important on this section of 
the survey (3.3, 3.2), but in their written comments about the size class 
they prefer, about 50% - 60% stated that they prefer classes of from 
16-50 because, there are more opportunities to interact with the 
instructor on a more personal l^vel. Also, 30% of the students wrote 
comments stating that one of the skills instructors should develop is the 
ability to interact effectively with students. It appears that, though 
they enjoy being able to interact and participate in class, they don't 
p.Tceive this interaction as being an essential part of the learning 
process. 

« 

By classification . The response means in this section when broken 
G'own by student classification are given in Table 5.12. In the analysis 
of the means for each student classification we can see that there is a 
siqnificant difference (p - .0005) between the means on Item 12 (Feeling 
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TABLE 5.12 - 

One-way ANOVA of Pre- and Post-Semester SAS Means by Classification 

for Items 11-19 







III- 


So. 




§!• 


Other 


Fvalue 


£ 


df 


Item 11 


pre 
post 


3.8 
3.7 


3.7 
3.8 


3.9 
3.8 


3.8 
3.8 


3.7 
3.7 


2.733 
.620 


.0279 
.6487 


4.2411 
4,1944 


Item 12 


★pre 
post 


4.2 
4.1 


4.2 
4.1 


4.3 
4.0 


4.0 
4.0 


4.0 
3.7 


5.082 
2.547 


.0005 
.0380 


4.2415 
4,1939 . 


Item 13 


pre 
post 


3.7 
3.6 


3.7 
3.7 


3.7 
3.6 


3 7 
3.7 


4 0 
4.0 


3 027 
2.569 


0886 

• w www 

.0366 


4 2413 
4,1947 


Item 14 


ore 
post 


3.5 
3.4 


3 4 
3.4 


3 5 
3.4 


3 4 
3.4 


3 4 
3.6 


1 • 

.426, 


.7903f 


4»1952 


Item 15 


ore 
post 


4 5 
4.4 


4 5 
4.4 


4.3 


4 4 
4.3 


4 3 
4.3 


2 237 
1.370 


0632 
.2424 


4 ?4l7 
4,1956 


Item 16 


pre 
post 


3.3 
3.3 


3.3 
3.3 


3.3 
3.2 


3.2 
3.2 


3.3 
3.3 


.989 
1 .618 


.4128 
.1674 


4,2377 
4,1881 


Item 17 


pre 
post 


4.0 
4.0 


3.9 
3.9 


3.9 
3.9 


3.9 
3.8 


3.7 

M 


2.189 
2.155 


.0683 
.0722 


4,2417 
4,1953 


Item 18 


pre 
*post 


3.7 
3.7 


3.6 
3.7 


3.5 
3.5 


3.7 
3.5 


3.7 
3.6 


2.595 
4.301 


.0351 
.0019 


4,2408 
4,1950 


Item 19 


pre 
post 


4.7 
4.7 


4.7 
4.6 


4.6 
4.5 


4.6 
4.5 


4.6 
4.5 


2.031 
3.613 


.0881 
.0062 


4,2408 
4,1945 



*Significant at P -.001. 

Fr (Freshmen), So (Sophomores), Jr (Juniors), Sr (Seniors), Other (Grad. 
students, etc.) . 

Scale: 1 (not important at all); 2 (somewhat important): 3 (moderately 
important); 4 (quite important); 5 (extremely important). 

Underlined # ind cate at least .3 difference between Pre- and Post-Semester 
Means. 




at ease when you talk to the instructor individually) in the Pre-semester 
data. Junior student* evidently felt at that time that this was more 
important to their learning than did the students in the other classes. 
It is interesting to note, however, that these Junior students rate this 
as somewhat less important in the Post-semester data (pre « 4.3; post * 
4.0). Also, this item does not show. a significant difference between the 
different level students in the Post-semester data. There is also a 
significant difference among the student levels on Item 18 (Having strong 
outside support material) in the Post-semester analysis. On this item it 
appears that Freshmen and Sophomores found this outside support Material 
to be more necessary than did the other students. From these data we see 
that Seniors and Others found such supporting materials to be less 
important at the €nd of the semester than at the beginning of the 
semester. 

By sex . The response means for this section were also analyzed by 
sex (see Table 5.13). For the most part the responses do not differ much 
by sex. However, on Item 12 (Feeling at ease when you talk to the 
instructor individually) there is a significant difference both in the 
Pre- and Post-semester surveys. The means indicate tnat this is more 
important to females than to males in their learning. Item 15 (Having 
the course material and assignments well -organized) also shows a 
significant difference between the means for both surveys. Here again, 
the finales indicated u'.at chis is more important to their learning than 
did the males. 
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TABLE 5.13 



One-way ANOVA of Pre- and Post-Semester SAS Means by Sex 

for Items 11-19 







Mala 


r ciiin 1 c 


^\l7i 1 no 

r Vu 1 uc 


n 


df 


Item n 


Pre 


3.8 


3.8 


.265 


• 6067 


1.2418 . 


Post 


J. / 






• w 1 Ow 


1 1Q52 


Item 12 


*Pre 




4.3 


30.552 


>.0001 


1.2422 


*Post 


4.0 


4,2 


1 C 1 7C 


• UUU 1 




Item 13 


Pre 


3.7 


3.7 


3.009 


.0831 


1,2420 


Post 


3.7 


3.7 


• POJ 




1 1 1 


Item 14 


Pre 


3.5 


3.5 


.364 


•5467 ' 


1,2418 


Post 






9 Ql 7 


• uoou 




Item 15 


*Pre 


4.4 


4.6 


46.729 


>.G001 


1.2424 


*Post 




4.0 




^ nnm 
>.UUUl 


1 1Qg4 


Item 16 


Pre 


3.3 


3.3 




.6268 


1.2384 


Post 


3.3 


3.2 


2.439 


.1187 


1.1888 


Item 17 


*Pre 


3.9 


4.0 


14.862 


.0001 


1.2424 


Post 


3.9 


4.0 


5.994 


.0145 


1.1960 


Item 18 


Pre 


3.6 


3.7 


5.055 


.0248 


1.2415 


Post 


3.6 


3.6 


.768 


.3810 


1.1950 


Item 19 


Pre 


4.6 


4.7 


6.0567 


.0140 


1.24>5 


*Post 


4.5 


4.6 


1?.785 


.0004 


1.1950 



*Significant difference at p - .001. 

Scale: 1 (not important at all). 2 (somewhat important), 3 (moderately 
important). 4 ^quite important), 5 (extremely important). 
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On Item 17 (Getting frequent feedback on your progress) a 
significant difference between the means is indicated in the Pre-semester 
analysis but not in the Post-semester analysis even though the means 
remain the same. This is due to the shift in the number of degrees of 
freedom. A similar phenomenon can be seen on Item 19 (Having an 
instructor who is very knowledgeable in the subject). 

By Instructor. Table 5.14 shows the Pre- and Post-semester means 
for each item. The means which change by at least .3 are underlined. 
Overall, 5 25U of the means at the end of the semester are lower (i.e., 
less important to their learning) than at the beginning of the semester 
while 19% increase and 2B% remain the same. The only item on which more 
of the means increase than decrease is Item 16 (Being able to actively 
participate in class). On this item e^ght (8) of the means increased, 
six (6) decreased, and \hree (?) remained the same. None of these 
changes are very large, but they ao indicate a slight shift in the 
students' attitudes toward feeling that participation is more important 
to their learning than they f3lt it was at the beginning of the semester. 
(It is interesting to note that alj. the means for the classes in Natural 
Sciences decreared on this 'tern; indicating that these students felt 
oarticipatioij was less important at the end of the semester than they had 
felt it was at tho beginning of the semester ) 

On Item 15 (Having course material and assignments well organized) 
all the means decrease except four which remain the same. Here again, 
these shifts are not extremely large except in the case of instructor #23 




TABLE 5.14 

Pre- and Post-Semester SAS Means by Instructor 

for Items 11-19 



NS E B LA Changes In 







rn 






13 


29 


14 


17 


21 


22 


26 


16 


20 


23 


24 


is 


27 


28 


Means 


Item 11 


pre 


3.9 


3.7 


3.7 


3.7 


3.0 


3.0 


4.0 


3.9 


3.0 


3.9 


3.8 


3.0 


3.0 




3.7 


3.7 


3.9 


+=5 




post 


4.0 


3.5 


3.7 


3.9 


3.7 


3.8 


3.9 


4.0 


3.8 


3.8 


3.9 


3.7 


3.8 


3.8 


3.7 


3.8 


3.8 


+=6-=6 


Item 12 


pre 


4.2 


4.2 


4.2 


4.3 


4.0 


3.9 


4.4 


4.0 


4.2 


4.2 


4.3 


4.2 


4.2 




4.3 


4.1 


4.2 






post 


4.3 


4.1 


3.9 


4.1 


3.9 


3.9 


4.0 


4.0 


4.0 


3.9 


4.2 


AO 


4.2 


4.1 


4.1 


4.0 


4.1 


+=ll--5 


Item 13 


pre 


3.5 


3.5 


3.8 


3.7 


3.9 


3.6 


3.9 


3.8 


3.6 


3.8 


3.4 


3.8 


3.6 




3.5 


3.7 


4.3 


f=4 




post 


3.6 


3.8 


3.8 


3.6 


3.8 


3.6 


3.8 


3.8 


3.5 


3.7 


3.3 


3.7 


3.6 


3.7 


3.7 


3.8 


4.2 




Item 14 


pre 


3.5 


3.3 


3.4 


3.6 


3.5 


3.5 


3.4 


3.4 


3.4 


3.5 


3.6 


3.4 


3.5 




3.5 


3.4 


3.6 






post 


3.5 


3.1 


3.4 


3.4 


3.5 


3.3 


3.3 


3.4 


3.3 


3.5 


3.5 


3.3 


3.5 


3.4 


3.5 


3.4 


3.7 




Item 15 


pre 


4.6 


4.4 


4.6 


4.5 


4.4 


4.4 


4.6 


4.4 


4.5 


4.5 


4.6 


4.4 


''.7 




4.6 


4.4 


4.1 


+=0 




post 


4.6 


4.2 


4.4 


4.4 


4.4 


4.3 


4.4 


4.3 


4.4 


4.3 


4.6' 


4.3 




4.3 


4 4 


4.2 


4.1 




Item 16 


pre 


3.2 


3.3 


3.3 


3.5 


3.2 


3.2 


3.4 


3.0 


3.2 


3.4 


3.2 


3.1 


3.3 




3.3 


3.1 


3.6" 


+=8 




post 


3.1 


3.2 


3.0 


3.5 


3.3 


3.1 


3.3 


3.9 


3.3 


3.5 


3.2 


3.3 


3.4 


3.2 


3.4 


3.2 


3.7 


+=6 


Item 17 


pre 


4.0 


3.9 


4.0 


4.1 


4.0 


3.9 


4.1 


4.0 


3.9 


4.1 


4.1 


3.9 


3,9 




3.8 


3.8 


3.8 


+=4 




post 


4.1 


4.0 


3.9 


4.2 


3.9 


3.8 


4,1 


3.9 


3.9 


3.8 


4.2 


3.8 


3.9 


3.-' 


3.8 


3.7 


3.4 


+:=8-==5 


Item 16 


pre 


3.6 


3.5 


3.9 


..7 


4.0 


3.6 


3.6 


3.9 


3.5 


3.4 


3.7 


3.6 


3.6 




3.8 


3.6 


3.6 






post 


3.8 


3.6 


3.7 


3.8 


3.9 


3.4 


3.5 


3.8 


3.4 


3.1 


3.9 


3.5 


3.4 


3.4 


3.6 


3.5 


3.6 


1=11-2 


Item 19 


pre 


4.7 


4.6 


4.7 


4.8 


4.6 


4.5 


4.8 


4.6 


4.6 


4.7 


4.7 


4.6 


4.7 




4.7 


4.5 


4.7 






post 


4.8 


4.6 


4.5 


4.8 


4.5 


4.4 


4.6 


3.5 


4.5 


M 


4.6 


4.5 


3.4 


4.5 


4.7 


4.4 


4.8 


^^lo-^'^ 



Underlined means indicate at least a .3 change hi veen pre- and post-semester SAS means. y^^^^ 
+ = # of means for that item which increase between the pre- and post-semester surveys. 
+ = # of means for that item which decrease between the pre- and post-semester surveys, 
o - « # of means for that item which remain constant between the pre- and post-semester surveys. 

ERIC? 6 



+-29 +=79 
(19%) (525^) 

-=43 
(28%) 
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where the mean decreases from 4.7 to 4.2. This decrease In the means 
seems to indicate that more of the students felt this instructional 
quality was a little less important at the end of the semester than they 
had thought it was at the beginning of the semester. 

Items 12 (Feeling at ease when you talk to the instructor 
Individually), 18 (Having strong outside support material, like the text 
and supplementary readings), and 19 (Having an instructor who is very 
knowledgeable in the subject) show the greatefit number of classes with 
decreases in their means. Of these, alj. the classes in the College of 
Business Indicate decreases on Items 18 and 19. 

By scanning Table 5.14 we notice that most of the larger changes in 
the means take place in the College of Business and particularly in the 
class of instructor #26. Of these larger shifts In the means, all of 
them decrease except for the one on Item 13 (Being challenged by the 
material and the instructor to think for yourself) under Instructor #12. 
The students in this class felt that this was more important to their 
learning at the end of the semester than at the beginning. 

Written comments . A number of the students who filled out the SAS 
provided written comments in Section V concerning other things which they 
felt were important to their learning. These comments have been 
summarized and are listed below. The percentage of students responding 
whose statements could be categorized into each summary statement are 
also given. 
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Other things which are important to learning are: 



1. Instructors of large classes need to develop good 
communication skills, Interaction skills, and 
teaching skl.lls. {29% of the 643 responding 
students) 

2. Instructors of large classes need to develop a 
good attitude toward the class (the emphasis is 
on enthusiasm and sincere concern for the 
students' welfare). {10% of the 643 responding 
students) 

3. Instructors of large classes need to provide more 
and different stimuli (field trips, movies, 
overhead transparencies, slides, etc.)* {^% of 
the 643 responding students) 

4. Classrooms need to have the proper equipment for 
learning. {5% of the 643 responding students) 

5. Evaluation of students' performances in large 
classes needs to be improved (having more 
homework, providing more feedback, having more 
essay items than multiple-choice items, and 
abolishing the "bell-shaped curve" distribution 
of grades). (5% of the 643 responding Students) 



Summary; Section II. On the whole, the students agree that the 
thing which most affects their learning in university classes is having 
an instructor who is knowledgeable in the subject and can communicate 
this knowledge to the students. The second most important aspect is 
having the course material and assignments well -organized and the third 
most important aspect is feeling at ease when talking to the instructor 
individually. 



Section III: Preferred Class Size (Items 20-24) 

In this section the students were given five class size categories 
which they were asked to rank from 1 (most preferred size) to 5 (least 
preferred size). The responses in this section were analyzed by the 
percent of the total responses and then the means were calculated by 
College, classification, sex and instructor. 

Overall percentages. The percent students responding in each 
category is given in Table 5.15. There is a definite preference for 
classes of size 16-30 and a majority of the students ranked the last 
thr'^e class size categories 3rd, 4th, and 5th. There seems to be some 
undecidedness about very small classes (size 1-15). On the Pre-semester 
survey, a larger portion of the students (26%) indicated that they 
preferred that size class (i.e.. ranked it #1), whereas on the 
Post-semester survey the larger portion (24%) ranked it 5th. Overall, 
there is..^ fairly even spread over the five ranks on Item 20 (size 1-15). 

By college. Table 5.16 shows the means for this section when broken 
down by College. These data indicate that there is a significant 
difference between the means on Item 20 (size 1-15) and Item 23 (size 
51-100) in both the Pre- and Post-semester surveys. The students in the 
College of Business prefer small classes (Item 20) less than do the 
students in the other three colleges and the means for all of the 
colleges increase on this item in the Post-semester data. On the other 
hand, the students in the College of Business prefer classes size 51-100 



TABLE 5.15 

Percentage of Student Responses to Items 20-24 









Pre 










Post 








1 


2 


3 


4 


5 


1 


2 


3 


4 


5 


Item 20 (Size 1-15) 


26* 


24* 


18 


12 


21 


23 


23^ 


/l9 


n 


24* 


Item 21 (Size 16-30) 


43* 


35 


10 


10 


,2 


43* 


33'^ 


10 


13 


1 


Item 22 (Size 31-50) 


21 


24 


48*. 


5 


3 


21 


26 


46* 


3 


3 


Item 23 (Size 51-100) 


7 


12 


17 


58* 


6 


8 


14 


17 


57* 


4 


Item 24 (Size 100+) 


5 


5 


9 


13 


68* 


6 


5 


9 


14 


66* 



*Highest response percentage for that item. 
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TABLE 5.16 

One-way ANOVA of Pre- and Post-Semester SAS Means by College 

- for Itoms 20-24 



tem 20 *Pre 

Size 1-15) *Post 

tem 21 Pre 

Size 16-30) *Post 

tem 22 *Pre 
Size 31-50) Post 

tem 23 *Pre 

Size 51-100) *Post 

tem 24 Pre . 

Size 100+) Post 



NS 


E 


B 


LA 


Fval ue 

15.498. 
7.878 






2.6 
2.7 


2.5 
2.7 


3.0 
3.1 


2.7 
2.9 


>.0001 
>.0001 


3,2438 
'3,2010 


1.9 
1.9 


1.9 
1.7 


2.0 
2.1 


1.9 
2.0 


' .8145 
5.163 


.4859' 
.0016 


3,2445 
3,2009 


2.6 
2.4 


2.6 
2.5 


2.3 
2.3 


2.5 
2.4 


12.295 
3.915 


>.O0Ol 
.0086 


3,244S 
3,2011 


3.5 
3.4 


3.6 
3.5 


3.3 
3.2 


3.4 
3.4 


7.947 
5.559 


>.O0Ol 
' .0009 


3,2444 
3,2015 


4.4 
4.3 


4.4 
4.5 


4.3 
4.2 


4.4 
4.3 


1.056 
2.256 


.3670 
.0804 


3,2439 
3,2019 



*Siginficant difference at p ^ .001. 

ScaW 1 (class size liked best) - 5 (class size liked least). 

NS (Natural Science), E (Engineering), B (Business), LA (Liberal Arts). 
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(Item 23) more than do the students in other colleges. The students In 
Enginee .ig definitely prefer 'classes of 16-30 students (Item 21) as is 
indicated by their rankings of 1.9 in tne Pre-semester data and 1.7 in 
the Post-semester data. Natural Science and Engineering students prefer 
classes of 31-50. (Item 22) and 51-100 (Item 23) less than do the students 
in Business and Liberal- Arts. This is probably because the content they 
must learn is more problem oriented and it helps their understanding if 
they can interact more with the instructor. All of the rankings follow 
the same pattern in each College (i.e., #1 = Item 21, #2 « Item 20, #3 = 
Item 22, #4 « Item 23, and #5 = Item 24). 

/ 

Classification. When the means for Itemc 20-24 are analyzed by 
student classification there -.omfi :ngnificant differences between the . 
means, as indicated ir Table 5.17. On ^l-m 20 (size 1-15) all of the 
students except those in the "Other" category indicate that ^ey like the 
smallest classes less at the end of the semester th..n they did at the 
beginning.; It is difficult to say why this occurs except that perhaps 
the students feel less pressure to perform in a class of 16-30 than in a 
class of 1-15. Also, the students :in the "Other" group were primarily at 
the graduate level and they felt they profit more from more one-to-one 
contact with the instructor. On Item 22 (size 31-50) in the 
Post-semester da^-a there is a significant difference between the means 
because it appears that the "Other" group likes this size class less than 
do. the rest of the students. 

By sex. • Table 5.18 shows the analysis of the means by sex. It is 
interesting to observe that ^-he ans for females change quite a bit from 
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TABLE '5.17 

One-way ANOVA of Pre- and Post-Semester SAS Means by Classification 

* for Items 20-24 







fr- 


So. 




Sr. 


Other 


Rvalue 


£ 






• re 


c • 0 


b • o 






2 3 


5 438 


0002 


4.2396 


(Size 1-15) 


Post 


2.8 


3.0 


3,0 


3.0 


2.2 


3.695 


.0054 


4,1925 


Item 21 


Pre 


1.9 


.1.9 


1.9 


2.0 


1.8 


.832 


.5047 


4,2403 


(Size 16-30) 


Post 


1.9 


2.0 


2.0 


2.1 


1 .9 


2.428 


.0463 


4,1933 


Item 22 


*Pre 


2.6 


2A 


2.3 


2.4 


2.5 


6.757 


>.0001 


4,2402 


(Size 31-50) 


*Post 


2.5 


2.4 


2.3 


2.3 


2.7 


5.655 


.0002 


4,1927 


Item 23 


Pre 


3.5 


3.5 


3.4 


3.3 


3.5 


3.342 


.0099 


4,2401 


(Size 51-100) 


Post 


3.4 : 


3.3 


3.3 


3.3 


3.6 


2.735 


' .0278 


4,1934 


It^24 


Pre 


4.3 


' 4.4 


4.4 


4.4 


4.6 


1.297 


.2692 


4,2400 


(Size^OO+) 


Post 


4.3 


4.3 


4.3 


4.3 


4.5 


.529 


.7144 


4,1937 



♦Significant difference at p ^ .001. 

Scale: 1 (cTass size liked best) - 5 (class size liked least) 

Fr (Freshmen), So (Sophomores), Jr (Juniors), Sr (Seniors), Other (Grad. 
students, etc.) 
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TABLE 5.18 



One-way ANOVA of Pre- and Post-Semester SAS M^ns by. Sex 

for Items 20-24 \. 







Male 


Femal e 


F value 


1 


if 


Item 20 
(Size 1-15) 


*Pre 
*Post 


2.0 
2.7 


3.1 


31.454 


^ • UUU 1 

>.0001 


1,1933 


Item 21 
(Size 16-30) 


Pre 
*Post 


1.9 
1.9 


1.9 
2.1 


.311 
10.308 


.5775 
.0014 


1,2410 

1 1 nil 1 
1 ,1941 


Item 22 
(Size 31-50) 


*Pre 
*Post 


2.5 
3.4 


2.3 
3.2 


25.436 
21.076 


>.000l 
>.0001 


1,2409 
1,1942 


Item 23 
(Size 51-100) 


*Pre 
•*Post 


3.5 
3.4 


3.3 
3.2 


18.171 
21 . 076 


>.0001 , 
>.0001 


1 ,2408 
1,1942 


Item 24 
(S.ze 100+) 


Pre 
Post 


4.4 
4.4 


4.4 
4.2 


.0013 
7.122 


.9713 
.0077 


1 ,2407 
1,1945 



*Significant difference at p ^ .001. 

Scale: 1 (class size liked best) - 5 (class size liked least). 
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the beginning of the semester to the end. For example, though they rank ^ 
Item 21 (size 16-30) lowest both times (1.9, 2.1), they seem to like that 
size less at the end of the semester than they did at the beginning of 
t.he semester. Also, females indicated that they like very small classes 
(size 1-15) less than males do. This is somewhat surprising because the 
females rated Item 12 (Feeling at ease when talking individually to the 
instructor) as more important to their learning than did the males (see 
Table 5.13). 

By instructor. The means for Items 20-24 are presented 'for each 
instructor in Table 5.19. (The instructors have been grouped by college 
to facilitate analysis of the data.) In Item 20 (size 1-15) all of the 
means increase except those for Instructor #14 in Business. Thi's 
indicates that most of the students liked this size class less at the end 
of the semester than they did at the beginning of the semester. The 
students in classes #li and #28 like this sire class more (2.5) than do 
the other students. 

For the most part the means for Item 21 (si^s 16-30) either remain 
the same or increase (i.e., the students liked this size class less at 
the end uf the semester). The major deviation from this pattern occurs 
in Instructor il'd's class where th.. mean decreases. Th' students in this 
class seem tc think classes of 16-30 students are the. '^al size. 

The means for Item 22 (size 31-50) remained pretty steady over tne 
semester. The changes which srand out occur ir; class #25, whera the mean 
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TABLE 5.19 



Pre- and Post-Semester SAS Means by Instructor 

for Items 20-24 



ro 



B 





Code 


Jl 


11 


15 


11 


29 




]7 


11 


22 


26 


16 


20 


23 




25 


H 


28 






Item 20 
(Size 1-15) 


pre 
post 


2.9 
3.0 


2.6 
2.7 


2.3 
2.5 


2.3 
2.6 


2.6 
2.9 


3.2 
3.0 


2.8 
3.1 


3.0 
3.2 


3.1 
3.3 


2.5 
2.7 


2.9 
2.8 


2.8 
2.7 


3.1 


2.7 
3.0 


3.2 
3.1 


2.4 
2.5 


2.4 
2.5 


+=12 
+=4 " 


=1 


Item 21 
(Size 16-30) 


pre 
post 


2.0 
2.0 


1.9 
1.9 


1.8 
1.8 


1.9 


1.9 
1.9 


2.1 
2.0 


1.9 
2.0 


1.9 
2.0 


2.0 
2.2 


1.8 
1.8 


1.9 
1.9 


1.7 
2.0 


2.1 


1.8 
2.0 


2.1 
2.2 


2.0 
1.8 


2.0 
1.8 


+=6 
+=4 


=7 


Item 22 
(Size 31-50) 


pre 
post 


2.3 
2.3 


2.7 
2.6 


2.8 

13 


2.7 
2.6 


2.5 
2.5 


2.3 
2.2 


2.5 
2.4 


2.2 
2.2 


2.2 
2.3 


2.4 
2.4 


2.4 
2.5 


2.5 
2.6 


2.1 


2.5 
2.3 


2.2 
2.5 


2.7 
2.6 


2.7 
2.6 


+=4 
+=8 ■ 


=5 


item 23 
(Size 51-100) 


pre 
post 


3.3 
3.2 


3.5 
4 


3.6 
3.6 


3.7 
3.7 


3,6 
3.4 


3.2 
3.3 


3.4 
3.3 


3.4 
3.3 


3.3 
3.1 


3.6 
3.5 


3.5 
3.4 


3.3 
3.5 


3.3 


3.5 
3.3 


3.1 
3.0 


3.6 
3.5 


3.6 
3.5 


+=2 
>^=12 


-=3 


Item 24 
(Size 100+) 


pre 
post 


4.4 
4.3 


4.-^ 
4.2 


4.4 
4.6 


4.5 
4.6 


4.4 
4.4 


4.3 
4.4 

-J 


4.1 
4.2 


4.4 
4.4 


4.4 
4.0 


4.6 
4.7 


4.3 
4.4 


\Z 
4.1 


4.3 


4.5 
4.3 


4.3 
4.3 


4.4 
4.5 


4.4 
4.5 


+=8 
+=4 ■ 


=5 



Instructor codes 11-17 taught classes during the Fall, 1980 semester. 

Instructor codes 20-29 taught classes during the Spring, 1981 semester. 

Underlined means indicate at least a .3 change jetween pre- and post-semester SAS means. 

+ = # of means for that item which increase between the pre- and post-semester surveys. 

+ = # of means for that item which decrease between the pre- and post-semester surveys. 

- = # of means for that item which remain constant between the pre- and post-semester surveys. 

Scale: 1 (class size liked best) - 5(class size liked least). 



Total +=32 
(38%) 

(25%) 

+=32 



ERIC 



87 



88 



increases from 2.2 to 2.5 (i.e.. the students like that i.ze less at the 
end of the semester), and in class #15, where the mean decreases from 2.8 
to 2.4 (i.e., the students like, that size class more at the end of the 
semester) . 

The means for Item 23 (size 51-100) decreased in all but five of the 
classes. This is somewhat surprising because that indicates that the 
students liked this size class more at the end of the semester; though 
overall, it is still ranked fourth. 

Finally, the means for Item 24 (size 100+) remained quite stable. 
At the end of the semester the students in classes #15, #13, and #26 
indicated that they really do not care for this size class: their means 
are 4.6, 4.6, and 4.7 respectively. The students in class #22, with a 
Post-semester mean of 4.0, indicated that they enjoy this size class more 
than do the rest of the stuoents. 

Written comments. Many students provided written comments in 
Section V of the SAS concerning their reasons for their first class size 
choice. These comments have been summarized an'^ are listed below. The 
percentage of students responding whose statements could be categorized 
into each summary statement are also given. 

Class size 1-15 ranked #1 because: 

1. The environment is more conducive to learning 
(i.e., students get more feedback, hear different 
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views on various issues, and interact more due to 
the class size). (57% of 742 students 
responding) 

2. Students are able to interact with instructor on 
a more personal level. (4956 of 742 students 
responding) 

3 Because students are noticed more by the 
instructor, they are more motivated to be 
prepared for class and to participate. (10% of 
742 students responding) 

4. Students . are able to get to know each other on a 
more personal level. (10% of 742 students 
responding) 



Class size 16-30 ranked #1 because: 



1. The environment is more conducive to learning 
(i.e., students get more feedback, hear different 
views on various issues, interact more, and feel 
more relaxed and comfortable). (43% of 1,323 
students responding) 

2. Students are able to interact with the instructor 
on a more personal level. (40% of 1,323 students 
responding). 

3. Students are tble to know each other on a more 
personal level. (25% of 1,323 students 

responding) 

4. Students have more control over when they want to 
participate in class (i.e., students fee' either 
less inhibited or less pressure to voici their 
opinions). (24% of 1,323 students responding) 



Class size 31-50 ranked #1 because: 



1, The environment is more conducive to learning 
(i.e., students get more feedback, hear diffui ent 
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views on various Issues, interact more, and feel 
more relaxed and comfortable). (44% of 540 
students responding) 

2. Students have more personal contact with the 
instructor. {29% of 540 students responding) 

3. Students have more control over when they want to 
participate (i.e., students feel less inhibited 
to participate). {27% of 540 students 
responding) 

'4. Students nave ijiore personal contact with each 
other. (19% of 540 students responding) 

5. Students are accustomed to this class size (not 
too big nor too small). (19% of 540 students 
responding) 



Class size 51-100 ranked #1 because: 



1. The instructor is more organized. (26% of 209 
students responding) 

2. Students have more control over when they want to 
participate in class (i.e., students feel less 
inhibited to participate). (23% of 209 students 
responding) 

3. Students are accustomed to this class size and, 
thus, are more comfortable. (17% of 209 students 
responding.) 



Class size 100+ ranked #1 because:. 



1. The atmosphere is more casual and relaxed since 
participation from each student is not required. 
(24% of 122 students responding) 

2. The instructor is more organized and more 
qualified to teach. (20% of 122 students 
responding) 

3. Students have more control over when they want to 
participate in class. (14% of 122 students 
responding) 
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Summary; Section III. The data presented above for Section III of 
the SAS indicate that students most prefer classes of 16-30 students 
because they feel more a part of the class and they find this environment 
more conducive to learning. These students least prefer classes with 
over 100 students because (1) they get less feedback from the instructor, 
(2) they do not feel like participating, (3) they feel distant from the 
instructor, and (4) they think that the course can be taught more 
efficiently in smaller groups. 

Section IV; Characteristics of Large Classes (Items 25-41) 

There have been a number of statements made about the pros and cons 
of large classes. In this segment of the SAS the students were asked to 
react to statements about things which happen as classes increase in 
size. Their responses were on a scale from 1 (disagree strongly) to 5 
(agree strongly). Again, the students' responses were analyzed by total 
percent responding to each item, by College, by classification, by sex, 
and by instructor. 

Overall percentages. The percent of students responding to each 
scale option for each item is given in Table 5.20. It appears that the 
students had somewhat stronger convictions or reactions during the 
Pre-semester survey than they did during the Post-semester survey. This 
ii evidenced by the number of asterisks (*) in column 5 for each survey. 
The only item with which they "strongly agree" both times is Item 41 (As 
classes get larger, a student's inability to take good notes in class 
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TABLE 5.20 



Percent of Students Responding To Each Degree 
Of Sw-'^ On SAS Items 25-41 









Pre 








Post 






1 


o 
C 


3 


4 


C 

w 


1 


2 


3 


4 


5 


Item 26 - less feedback 


z 


1 1 


12' 


44* 


70 


■a 


15 


11 


42* 


29 


Item 26 - not participate 


o 
0 


1 1 


12 


37* 


JO 


A 


12 


13 


37* 


34 


Item 27 - more organized 


6 


19 


32* 


31 


\ J 


Q 


18 


32* 


32* 


12 


Item 28 - mostly facts 


8 


23 


21 


33* 


15 


9 


25 


18 


32* 


17 


Item 29 - more resp. 


3 


9 


2Q 


43* 


24 


4 


10 '2Q 


45* 


21 


Item 30 - text 


3 


8 


13 


37 


39* 


4 


10 


14 


40* 


33 


Item 31 - pace 


4 


11 


18 


33 


35* 


4 


12 


21 


34* 


30 


Item 32 - more control 


18 


23 


22 


25* 


11 


17 


21 


23 


28* 


11 


Item 33 - don't know 
other stud. 


6 


16 


13 


32 


33* 


/ 


18 


14 


33* 


CO 


Item 34 - more efficient 


23 


36* 


25 


11 


4 


20 


36* 


29 


11 


4 


Item 35 - less challenge 


17 


32* 


24 


19 


8 


16 


33* 


23 


19 


9 


Item 36 - more freedom 


13 


21 


26 


29* 


12 


12 


20 


27 


30* 


12 


Item 37 - lower int. 
level 


17 


34* 


31 


12 


6 


1 ft 

18 


37* 


27 


11 


D 


Item 38 - not ask help 


7 


16 


n 


38* 


28 


7 


18 


12 


39* 


25 


Item 39 - quality better 


15 


30 


37* 


13 


5 


15 


30 


36* 


13 


5 


Item 40 - feel distant 


4 


9 


11 


39* 


37 


4 


12 


12 


39* 


33 . 


Item 41 - notetaking 


4 


7 


15 


34 


40* 


/I 


8 


15 


35 


38* 



*Highest response percentage for that item. 

Scale: 1 (disagree stronglv), 2(disagree moderately), 3(no opinion), 
4(ag»'ee moderately), 5(agree strongly) 
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makes It difficult for him/her to do well on exams). Items 30. 31. and 
33 are agreed with in the Post-semester data but not as strongly as they 
were in the Pre-semester responses. 

Many of the students disagreed with Items 34 (As classes get larger, 
the material in the course can be covered more efficiently). 35 (As 
classes get larger. I'm less challenged to think for myself), and 37 (As 
classes get larger, the course is usually taught at a lower intellectual 
level than I like). These responses show that many students feel they 
are being challenged to develop their thinking skills in large classes; 
perhaps more than an observer would expect. 

Ppar.on correlation. When a Pearson Product Moment Correlation 
Coefficient was calculated on the Post-semester data for the items in 
this section it was found that Items 39 and 40 correlated highly (.31 - 
.47) with several of. the other items. For Item 39 (As classes get larger 
the overall quality of Instruction seems to get better) students feel 
that the quality of the course gets better when: 

a. the instructor puts more effort into the course's 
organization (Item 27) r = .31; and 

b. the course is covered more efficiently (Item 34) r = .47. 
However, this comparison also indicates that: 



c 



the ability of students to interact with the instructor on 
• TLe Je^sonal level (Item 40) is not seen as improving 
the overall quality of the course (r = -.3u;. 
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In other words, from the students' point of view the quality of 
instructi.on gets better if the instructor is well-organized and doesn't 
waste class time, but it is not really affected by the instructor's 
interest in interacting with tie students on a personal l^vel. 

On Item 40 (As classes get larger I feel more distant from the 
instructor) students feel that their relationship with the instructor is 
distant when: 

I 

\ 

a. the instructor gives them less feedback on their 
performance (Item 25) r » .31; 

/ 

b. the students do not feel part of the class (Item 26) r = / 
.38; 

c. students are only required to memorize facts for the course 
(Item 28) r « .35; 

d. the course's pace is not irr harmony with the students' 
learning pace (Item 31) r - .43; 

e. students are unable to know other members of the class 
(Item 331 r = .32; and, 

f. students lack skills in notetaking (Item 41) r =» .30. 

Thus, instructors can make students feel less distant from them if they 
will: (1) provide frequent feedback on their performance, (2) nave 
students introduce themselves to the others sitting around them, (3) 
challenge the students to think and not just memorize facts, (4) ask for 
feedback on how the students feel the course is progressing before the 
end of the semester, and (5) emplcy the services of RASSL to teach the 
students notetaking skills. 
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By college . The response means are reported for each college l.i 
Table 5.21 and .Significant differences between the means are s'^en on 
quite a few of the. items. On Item 28 (As classes get larger the course 

> 

content becomes mostly facts to be memorized) p = .0007 (Pre) and >.00Ol 
(Post). Though the mean ,average is 3.2 (no opinion) the students in 
Engineering lean toward "disagree moderately" while those in Business 
lean more toward "agree moderately". The Engineering students seem to 
feel that the content of their courses does not consist of just facts to 
be memorized but also problems to be solved, while those in Business see 
the content as primarily facts. 

Item 30 (As classes get larger a good textbook and relevant outside 
readings become more important to my understanding of the content) also 
"hows a significant difference (p «>.0001 Pre and Post) among the 
colleges. In this case, the students in Engineering "agree moderately" 
(4.2) that this statement is true while those in Liberal Arts are less 
sure that this is so (3.9). This may be because the exam.s in Engineering 
tend to be based more' on the text and the lectures more closely follow 
the text than do those fn Liberal Arts. 

Item 31 (As classes get larger the pace of the course bec;)mes less 
geared to the students' pace of learning) shows a signi"-ant difference 
(p = .0004) in the Post-semester responses but not in the Pre-semester. 
This is because all of the means drop between the Pre- and Post-semester 
except in Business, which remains constant. Evidently, the instructors 
in the othtr three colleges were perceived as having attempted to pace 
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TABLE 5.21 

One-way ANOVA for Pre- and Post-Semester SAS Means by College 

for Items 25-41 







NS 


. E 


B 


LA 


Rvalue 


p 


df 


Item 25 


Pre 
Post 


3.8 
3.6 


3.8 
3.8 


3.9 
3.9 


3.9 
3.8 


1.720 
4.592 


.1613 
.0034 


3,2458 
3,2037 


Item 26 


Pre 
Post 


3.9 
3.8 


3.9 
3.9 


4.0 
4.0 


3.9 
3.8 


1.417 
3.960 


.2362 
.0080 


3,2417 
3,1931 


Item 27 


Pre 
Post 


3.3 
3.4 


3.4 
3.2 


3.2 
3.2 


3.2 
3.3 


1.975 
°4.110 


.1160 
.0065 


3,2454 
. 3,2038 


Item 28 


*Pre 
*Post 


3.2 


3.1 
3.2 


3.4 
3.5 


3.2 
3.2 


5.756 
22.794 


.0007 
>.0001 

% yjyjyj X 


3,2454 
. 3,2035 


Item 29 


Pre 
Post 


3.9 
3.8 


3.9 
3.8 


3.7 
3.6 


3.7 
3.6 


4.796 
3.642 


.0025 
.0124 


3,2452 
3,2037 


Item 30 


*Pre 
*Post 


4.0 
3.9 


4.2 
4.2 


4.0 
3.9 


3.9 
3.8 


7.847 
11.270 


.>.000I 
>,0001 


3,2449 
3,2031 


Item 31 


Pre 
*Post 


3.§ 
3.7 


3.9 
3.7 


3.9 
3.9 


3.8 
3.6 


1.040 
6.071 


.3742 
.0004 


3,2451 
3,2039 


Item 32 


'Pre 
*Post 


3.0 
3.2 


2,8 
2.9 


2.8 
2.8 


2.9 
3.0 


2.373 
5.218 


.0688 
.0014 


3,2446 
3,2028 


Item 33 


Pre 
Post 


3.6 
3.6 


3.6 
3.4 


3.7 
3.6 


3.7 
3.6 


1.318 
1 .995 


.2673 
.1 131 


3,2450 
3,2032 


Item 34 


Pre 
Post 


2.4 
2.5 


2.3 
2.4 


2.4 
2.5 


2.4 
2.4 


.8815 
.631 


.4501 
.5950 


3,2444 
3,2028 


Item 35 


*Pre 
*Post 


2.5 
2.. 5 


2.5 
2.5 


2.9 
3.0 


2.6 . 

2.7 ' 


17.^564 
22.048 


-'.COOl 
>.0001 


3,2442 
3,2034 


Item 36 


Pre 

rOS u 


3.1 


3.0 


3.1 

O. 1 


3.1 

0. 1 


...924 
1 .3/3 


.4285 
.2495 


3,2442 
3,2027 


Item 37 


Pre 
*Post 


2.5 
2.4 


2.6 
2.4 


2.5 
2.7 


2.6 
2.5 


2.065 
6.832 


.1032 
.0001 


3,2436 
3,2024 


Item 38 


*Pre 
*Post 


3.4 
3.5 


3.7 
3.6 


3.7 
3.8 


3.7 
3.4 


6.121 
8.395 


.0004 
>.0001 


3,2437 
3,2029 


Item 39. 


*Pre 
*Post 


2.8 
2.8 


2.7 
2.6 


2.5 
2.5 


2.6 
2.6 


5.588 
5.394 


.0008 
.0011 


3,2435 
3,2021 


Item 40 


Pre 
*Post 


3.9 
3.8 


4.1 
3.9 


4.1 
4.0 


3.9 
3.8 


2.511 
8.003 


.0573 
>.0001 


3,2435 
3,2021 
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TABLE 3.21 (continued) 



Item 41 



Pre 
Post 



NS 


E 


B 


LA 


Fvalue 






4.0 
4.0 


3.9 
3.8 


3.9 
3.9 


4.1 
- 4.0 


4.663^ 
2.149 


.0030 
.0925 


3,2345 
3.1983 



*Signif leant difference at p .001. 

Scale: 1 (disagree strongly, 2 (disagree moderately) , 3 (no opinion), % 

4 (agree moderately), 5 (agree strongly). 
Underlined # indicate at least .3 difference between Pre- and Post-Semester 

Means . 
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the course more to the students' needs. Perhaps they encouraged student 
input on .how the course was going and made changes accordingly. 

Item' 32 (As classes get laraer I have more control over how involved 
I am in the class) also shows a significant difference (p = .0014) in the 
Post-semester responses. The mean in the College of Business remained 
stable (2.8 - disagree moderately) while the means in the other colleges 
moved slightly toward 3 (no opinion). The students in large classes 
often do not see themselves as being involved while in the class. They 
just go to class and sit there taking notes. Thus, the "no opinion'^- 
response seems most appropriate. 

The next item which shows a significant difference among the four 
colleges is Item 35 (As classes get large I'm less challenged to think 
for myself) where p = .0001 for both Pre- and Post semester responses. 
The overall ^•esponse to this Item is 2.7 (disagree moderately), however 
the means . for the College of Business (2.9, 3.0) Indicate that those 
students really have "no opinion" about this statement. It is somewhat 
surprising that the students in Natural Science and Engineering disagree 
with this statement. Perhaps as their classes get larger they find that 
they must take the initiative and do things on their own if they are 
going to learn the content. 

Item 37 (As classes get larger the course is usually taught at a 
lower intellectual level than I like) shows a significant difference (p » 
.0001) among the colleges in the Post-semester data but not in the 
Pre-semester. For this statement all of the means move more toward 2 
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(disagree moderately) except those In the College of Business, which 
moves toward 3 (no opinion). This is encouraging information because 
many instructors feel they have to compromise on some cf ^heir goals for 
the class when it gets larger. The students, however, seem to feel that 
the courses are still intellectually stimulating. 

A sipnificant difference among the colleges in both thu Pre- and 
Post-semester responses (p = .0004, p - ,0001) is indicated for Item 38 
(As classes get larger I am less likely to seek out the instructor for 
individual help). In the Pre-semester data -the students, in the Natural 
Sciences rated this statement 3.4 (no opinion) while those in the other 
three colleges leaned more toward 4 (ag-ree moderately). However, in the 
Post-semester means the students in Liberal Arts responded at 3.4 (no 
opinion); a decrease from 3.7 in the Pre-semester data. Evidently these 
students found their instructors to be quite accessible whereas the 
students in the other three colleges found their instructors to be less 
accessible. • 

Item 39 (As classes get larger the overall quality of instruction 
seems to get better) also shows a significant difference (p = .0008; p = 
.0011) among the means of the four colleges. Here, the students in the 
College of Business disagree most with this statement {J = 2.5) while 
those in Natural Science lean more toward 3 (no opinion). Overall, the 
students do not feel that the quality of instruction in large classes is 
better th^n that in smaller classes. 
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Finally, there is a significant difference in the Post-semester data 
among the colleges (p = .0001) on Item 40 (As classes get larger I feel 
more distant from the instructor). Though all of the students tend to 
^'.gree with this statement, those in Business agree more fervently (4.0). 
All of. the means for this item decrease from the Pre- to the 
Post-semester responses with the responses of the students in Engineering 
changing the most (4.1, 3.9). Evidently, some of the students did not 
feel as distant from the instructor at the end of the semester as they 
had at the beginning. 

By classification. The students' response means are presented by 
classification in Table 5.22. The first item which shows a significant 
difference (p = .0001) among the means by classification is Item 27 (As 
classes get larger instructors seem to put more effort into the 
organization of the course). There is a significant difference on this 
item in the Pre-semester data but not in the Post-semester data. The 
Freshmen seemed to agree with this statement (3.4) more than did the 
other students (3.2) though the means really indicate primarily "no 
opinion" responses. 

Item 28 (As classes get larger the course content becomes mostly 
facts to be memorized) shows a significant difference among the means (p 
= .0001) in the Post-semester responses. The Freshmen and Sophomores 
tend to disagree with this statement while the Juniors and Others agree 
to a greater extent. It is interesting to note that the means for 
Freshmen and Sophomores decreased on this item from the Pre- to 
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TABLE 5.22 



One-way ANOVA for Pre- and Post-Semester SAS Means by Classification 

for Items 25-41 









So. 


Jr. 


Ttpm 2^ 


Pre 


3.9 


3.9 


3.9 




Post 


3.8 


3.7 


3.8 


itciTi CQ 


r re 


3 9 


3 9 


4.0 




Post 


3.8 


3.9 


3.9 




r r e 


3 4 


3 2 


3.2 




Post 


3.3 


3.4 


3.3 


i tClll CO 


r 1 e 


3 2 


3.2 


3.3 




*Post 


3.0 


3.1 


3.4 


itciTl 


r I c 


4 0 


3.7 


3.7 




*Post 


3.8 


3.8 


3.7 


Tfpm 30 

1 UCUl WW 


i 1 G 


4.1 


3.9 


4.0 




Post 


4.0 


3.9 


3.9 


1 UCIIl w 1 


Pre 

lie 


3.9 


3.8 


3.8 




Post 


3.8 


3.7 


3.8 


Item 32 


Pre 


2.9 


2.9 


2.9 




Post 


3.0 


3.1 


2.9 


Ttpm 33 


Prp 


3.7 


3.7 


3.7 




Post 


3.5 


3.5 


3.7 


i tciTl OH 


Prp 

lie 


2 4 


2.3 


2.4 




Post 


2.5 


2.4 


2.4 


Tfom 

1 UclTl 03 


^Prp 
r 1 e 


2.5 


2.6 


2.8 




*Post 


2.5 


2.6 


2.9 


Tfnm 3A 
item OU 


Prp 

r I e 


3 1 

W • 1 


3 1 


3.1 




PnQ t 


3 1 


3 1 


3.1 


Item 37 


Pre 


2.5 


2.5 


2.6 




*Post 


2.3 


2.4 


2.6 


ItGin 38 


Pre 


3.7 


3.6 


3.6 




Post 


3.5 


3.5 


3.7 


Item 39 


*Pre 


2.8 


2.5 


2.5 




Post 


2.7 


2.6 


2.6 


Item 40 


Pre 


4.0 


4.0 


4.0 




Post 


3.9 


3.8 


3.9 



it. 


Other 


Rvalue 






3.9 
3.7 


3.5 
3.6 


2.504 
1.537 


.0408 
.1894 


4.2415 
.4,1948 


4.0 
3.8 


3.7 
3.9 


2.311 
1.320 


.0561 
.2605 


4.2383 
4.1872 


3.2 
3.2 


3.2 
3.1 


6.191 
1.104 


.0001 
.3532 


4.2411 
4,1948 


3.3 
3.3 


3.2 
3.4^ 


1.952 
9.385 


.0997 
>.0001 


4,2410 
4,1946 


3.6 
3.5 


3.5 
3.5 


11.4571 
7.383 


^.0001 
>.00Ol 


4,2409 
4,1947 


3.9 
3.9 


4.0 
3.8 


4.446 
1.221 


.0014 
.3001 


4,2407 
4,1947 


3.9 
3.7 


3.7 
3.9 


.880 
..955 


.4755 
.4315 


4.2407 
4,1949 


2.9 
3.0 


2.9 
2.8 


.045 
1.383 


.9961 
.2377 


4.2402 
4,1939 


3.7 
3.5 


3.6 
3.7 


.280 
2.067 


.8910 
.0831 


4,2406 
4.1944 


2.4 
2.4 


2.3 
2.4 


.484 
.442 


.7477 
.7782 


4.2399 
4,1940 


2.9 
3.0 


3.0 
3.0 


14.485 
14.1819 


>.0001 
>.0001 


4.2398 
4.1944 


2.9 
3.0 


2.8 
2.8 


2.466 
.923 


.0434 
.4496 


.4,2399 
4.1938 


2.7 


2 a 

3.0 


2.058 .0843 
9.5838 >.0001 


4.2393 
4.1936 


3.6 
3.5 


3.6 
3.8 


1.092 
1.718 


.3591 
.1438 


4.2397 
4.1940 


2.6 
2.5 


2.3 
2.5 


7.161 
1.156 


>.0001 
.3286 


4,2391 
4.1934 


4.0 
3.8 


4.0 
4.0 


.309 
1.377 


.8723 
.2398 


4.2395 
4,1933 


86 
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TABLE 5.22 (Continued) 



in- 


So. 


Jr. 


Sr. 


Other 


Fvalue n 




Item 41 *Pre 4.1 
*Post 4.1 


4.0 
3.9 


4.0 
4.0 


3.8 
3.8 


3.7 
3.5 


5.913 .0001 
6.674 >.0001 


4i2307 
4,1896 



*Siginficant difference at p ^ .001. 

Fr (Freshmen), So (Sophomores), Jr (Juniors), Sr (Seniors) , Other (Grad. 
students, etc.). 

Scale: 1 (disagree strongly), 2 (disagree moderately), 3 (no opinion), 
4 ( agree moderately), 5 ( agree strongly). 
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Post-semester survey while those of the other three classifications 
either increased or stayed the same. This is probably due to the lack of 
experience of these lower-division students in the arts of notetaking, 
studying, and test-taking. 

Item 29 (As classes get larger I have t^^ .rtunity to take more 
responsibility for my own learning) shows a significant difference among 
the means in both the Pre- (p = .0001) and Post-semester (p =.0001) data. 
At the beginning of the semester the Freshmen "agree moderately" (4.0) 
with this statement while at- the end of the semester they lean more 
toward "no opinion" (3.8). The other students' responses remain 
relatively stable around the 3.5 - 3.6 level. 

Item 30 (As classes get larger a good textbook and relevant outside 
readings become more important to my understanding of the content) 
reflects a significant difference (p = .0014) only in the Pre-semester 
data. Here, though all of the students basically agree with this 
statement the Freshmen agree most fervently (-4.1). Though there is no 
significant difference among the means on the Post-semestar survey, the 
mean for the students in the "Other" group droDS from 4.0 to 3.8. This 
indicates^hat they fojnd the text and outside readings less of a 
necessity in a larger class by the end of the semester than they thought 
they would at the beginning. 

A significant difference among the means is indicated for both the 
Pre- and Post-semester surveys for Item 35 (As classes get larger I am 
less challenged to think for mysel-'). It is noteworthy that the means 
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for each classification on this, item increase with the level of the 
students (i.e.. Fr. " 2.5. So. « 2.6, Jr. * 2.8. Sr. = 2.9. 0. = 3.0). 
Thus, the lower the level of the student the more they feel they are 
challenged to think in their large classes. 

On Item 37 (As classes get larger the course is usually taught at a 
lower intellectual level than I like) there is a significant difference 
(p = .0001) among the means iu the Post-semester data. When the Pre- and 
Post-semester survey means are scrutinized, the means for Freshmen and 
Sophomores decrease while those for Juniors. Seniors, and Others remain 
the same or increase. Again, this is probably due to the level of 
experience of .the students; the older, more experienced students find 
their large courses less of a challenge. 

There is quite a bit of difference among the Pre-semester means (p « 
.0001) on Item 39 (As classes got larger the overall quality of 
instruction seems to get better). The Freshmen (2.8) disagree with this 
statement less than do the Others (2.3). However, in the Post-semester 
data the Others indicate that they agree more (2.5) while the Freshmen 
agree less (2.7). 

Finally. Item 41 (As classes get larger a student's inability to 

take good notes in class makes it difficult for him/her to do well on 

exams) shows a significant difference in both the Pre- (p = .0001) and 

Poit-semester data (p = .0001). Again, the mean responses on this item 
seem to reflect the experience of the students. Freshmen "agree 



moderately" (4.1, 4.1) while the Other students have "no opinion" (3.7, 
3.5). 



By sex . In Table 5.23 the response means for Items 25-41 are broken 
down by sex. As we can see, there is basically very little difference 
between the responses for males and females (e.g., only four items 
indicate significant differences in the Pre-semester survey and three in 
the Post -semester survey). 

The first item showing a significant difference^tween the means ib 
Item 29 (As classes get larger I have the opportunity to take more 
responsibility for my own learning). On this item in the Pre-semester 
data the mean for the females is very close to "agree moderately" (3.9) 
while that for the males indicates more of them have "no opinion" (3.7). 
There is no significant difference in the Post-semester data. 

Item 32 (As classes get larger I have more control over how involved 
I am in the class) reflects a significant difference between the means (p 
= .0014) on the Pre-semester data but not on the Post-semester data. 
Here, the males "disagree rr.?derately" (2.8) while the lemales' responses 
reflect "no opinion" (3.0). Thus, the males seem to feel that they have 
less control over their in-class involvement than do the females. 

There is a significant difference (p - .0012) between the means for 
Item 33 (As classes get larger I am less likely to know other students in 
the class) in the Po-' -semester data. The mean responses for this item 



TABLE D.23 



One-way ANOVA for Pre- and Post-Semester SAS Means by Sex 

for Items 25-41 



• 




na 16 


r cina 1 6 


r Vd 1 ue 


£ 


QT 


Item 25 


Pre 


3.9 


3.9 


.273 


.6012 


1,2422 


• 


Pnc ^ 


T ft 


1 ft 




fiino 


1 1 QC^ 


Itfcm 26 


Pre 


3.9 


3.9 


.0003 


.9868 


1 ,2390 




D ne 4- 

rOS u 




•5 Q 


1 . 1 10 




1 1 Qon 
1 , 1 ooU 


Item 27 


Pre 


3.2 


3^3 


3.395 


.0657 


1,2418 


• 


rOSX 


J* J 


O.J 
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on 1 n 

.yulu 


1 , 1^00 


Item 28 


Pre 


3.2 


3.3 


5.737 


.0168 ' 


1,2417 




Doe i" 
r US U 


^ 9 


J • J 


7 Q79 




1 IQCA 


Item 29 


*Pre 


3.7 


3.9 


19.355 


>.0001 


1,2416 




rust 


1 7 


'k 1 


1 • 001/ 




1 IQ^c^ 


Item 30 


Pre 


. 4.0 


4.0 


1.9606 


.1618 


1,2414 








\ Q 


A.1Q 


. 0 1 / H 


1 iQc^t: 


Item 31 


Pre 


3.8 


3.9 


3.432 


.0643 


1,2414 


• 


Pncf 
rUS U 


^5 7 


o . o 


. u90 




1 1QR7 


Item 32 


*Pre 


2.8 


3.0 


10.259 


.0014 


1,2409 




Doe ^ 
rUS u 




0. 1 


in n7R 


nni ^ 

.UU 1 0 


1 1QA7 


Item 33 


Pre 


3.6 


3.8 


7.444 


.0065 


1,2413 
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Item 34 
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2.3 


2.4 


3.994 


.0459 


1,2406 
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1 IQAQ 


Item 35 


Pre 


2.7 


2.7 


.0003 


.9868 


1,2405 




rOS t 


0 7 


0 7 


1 007 




i , lyoc 


Item 36 


*Pre 


3.0 


3.2 


16.307 


.0001 


1,2406 




*Post 


3.0 


■ 3.2 


11.556 


.0007 


1,1946 


Item 37 


*Pre 


2.7 


2.3 


55.478 


>.0001 


1,2400 




*Post 


2.6 


2.4 


32.0632 


>.0001 


1,1944 


Item 38 


Pre 


3.6 


3.6 


.2997 


.5842 


1,2404 




Post 


3.5 


3.6 


.452 


.5017 


1,1948 


Item 39 


Pre 


2.6 


2.6 


.197 


.6575 


1,2398 




Post 


2.6 


2.6 


.103 


.7486 


1,1942 


Item 40 


Pre 


4.0 


4.0 


.767 


.3812 


1,2402 




Post 


3.9 


3.9 


.003 


.9572 


1.1940 
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Table S.ZZ (Contlnu-jd) 







Male 


Female 


Fvalue 


£ 


df 


Item 41 


Pre 
Post 


4.Q 
3.9 


"4.0 
4.0 


1.148 
3.427 


.2843 
.0644 


1.2314 
1.1904 



^Significant difference at p - .001. 

Scale: 1 (disagree strongly), 2 (disagree moderately), 3 (no opinion). 
4 (agree moderately), 5 ( agree strongly). 
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Indicate that females agree more with this statement (3.7) than do the 
males (3.5); however, technically, the responses all fall within the "no 
opinion" range. 

Item 36 (As classes get larger I feel I have more" freedom becausej^ 
am pvt of a crowd and not so not iceahle.) -shows-- a-si^nTfiMnt difference 
between the means in both the Pre- and Post-semester responses (p = 
.0001; p » .0007). Evidently more females agreed with this statement 
than did the males. The means of 3.0 (males) and 3.2 (females) however' 
represent a predominately "no opinion" response from both sexes. 

Finally, Item 37 (As classes get larger the course is usually taught 
at a lower intellectual level than I like) also shows a significant 
difference between. the means on both the Pre- and Post-semester surveys; 
Both sexes disagree with this statement but the females tend to disagree 
more fervently than the mal-^s- |he means show a slight change between 
the Pre- and Post-semester si r ^ys withithe mean for males decreasing 
from 2 J to 2.6 and the mean for females increasing from 2.3 to 2.4. 
This change would indicate that more males disagreed with the statement 
at the end of the semester than did at the beginning of the semester 
(i.e., they feel that large classes are not taught at a lower 
intellectual level). On the other hand, more females agreed with the 
statement at the end of the semster (i.e., they felt that large classes 
are taught at a lower intellectual level). 

By instructor . The response means for each item are broken down by 
instructor in Table 5.24. The Pre- and Post-semester means for each item 
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^ TABLE 3 .24 

--^fe^nd, Post- semester SAS Means 8y Instructor 
" . * for Items 25-41 
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Change in 






Jl ' 


12 


li 


Jl 


29 


-11 


17 


11 


22: 


26 




20 


23 


li 


15 


IZ 


28 


Means 


Item 25 


pre 
post 


4.0 
3.9 


3.8 
3.4 


3.7 
3.6 


3.7 
3.9 


3.9 

3,. 7 


4.0 
3.8 


3.9 
4.0 


3.8 
3.6 


3.9. 
3.9 


4.1 
4.0 


3.9 
4.2 


3.9 
3.7 


4.1 
3.8 


3.8 


4.0 
3.6 


3.6 
3.6 


3.9 
3.7 


+=11 —3 


Item 26 


pre 
post 


3,9 
3.9 


3.8 
3.6 


4.0 
3.8 


4.0 

. 3.4 


3.9 
4.0 


4.0 
3.9 


3.7 
4.0 


3.9 
3.9 


4.t 
4.0 


4.1 
4.0 


3.8 
4.0 


3.9 
3.7 


4.0 
3.6 


3.9 


3.9 
3.7 


3.7 
3.8 


3.8 
3.5 


+=10 — ^ 


Item 27 


pre 
post 

• 


3.2 
3.3 


3.4 
3.5 


3.1 
3.3 


3.4 
3,3 


3.4 
3.0 


3.3 
3.1 


3.4 
2.9 


3.2 
3.2 


3.2 
3.4 


3.2 
3.0 


3. .3 
3.1 


3.0 
3.4 


3.0 
3.1 


3.2 


3.3 
3.5 


3.1 
3.3 


3.2 
2.1' 


f=8 

1=7 -=2 


Item 28 


pre 
post 


3.4- 
3.4 


3.1 

TX 


2.9 
2.8 


3.3 
.3.3 


3.0 
3.1 


3.6 
3.7 


3.8 
3.9 


3.1 
2.9 


3.3 
3.7 


3.4 
3.6 


3.5 
3.4 


3.0 
3.1 


3.3 
3.0 


3.4 


3.3 
3.1 


3.3 
3.3 


3.1 

HI 


+=6 


Item 29 


pre 
post 


3.9 
3.8 


3.9 
3.8 


3.7 
3.7 


4.0 
3.9 


3.8 
3.7 


3.7 
3.6 


4.0 
3.5 


3.6 
3.7 


3.6 
3.7 


3.4 
3.5 


4.1 
3.9 


3.7 
3.7 


3.7 
3.6 


3.5 


3.6 
3.7 


3.6 
3.7 


3.5 
3.3 


1=9 —3 


1 tClll JU 


post 


4 0 
3.9 


3.9 
3.8 


4.1 
4.1 


4.1 
4.3 


4.3 
4.2 


3.9 
3.9 


4.1 

3.7 


4.2 
4.2 


4.0 
3.8 


4.0 

HI 


4.3 
4.2 


3.9 
3.7 


4.0 
3.9 

• 


3.8 


3.8 
3.6 


3.9 
3.9 


3.8 
3.6 


+=11 


Item 31 


pre 
post 


3.9 
3.9 


3.7 
3.6 


3.8 
3.7 


4.0 
4.0 


3.8 
3.5 


3.9 
4.0 


3.9 
3.9 


3.9 
3.8 


3.9 
3.8 


4.0 
4.1 


3.9 
4.2 


3.7 
3.5 


4.0 
3.9 


3.6 


3.9 
3". 6 


3.7 
3.3 


3.8 
3.3 




Item 32 


pre 
post 


3.1 
3.2 


3.1 
3.3 


2.7 
3.0 


2.8 
2.8 


2.8 
2.9 


2.9 
2.9 


3.0 
2.8 


2.9 
2.9 


2.8 
2.8 


2.6 
2.8 


2.8 
2.9 


2.9 
2.8 


2.6 
3.2 


3.0 


2.8 
2.9 


3.1 
3.4 


3.1 
3.2 


+=10 ^ 
1=2 ""5 


Item 33 


pre 
post 


3.6 
3.8 


3.8 
3.6 


3.3 
3.4 


3.5 
3.4 


3.6 
3.4 


3.6 
3.4 


3.9 
3.7 


3.7 
3.5 


3.7 
3.8 


3.9 
3.2 


3.7 
3.7 


3.7 
3.5 


3.9 
3.6 


3.8 


3.8 
3.5 


3.7 
3.6 


3.8 
3.6 


+=12 — 


Item 34 

110 


pre 
post 


2.4 
2.. 3 


2.5 
2.7 


2.3 
2.4 


2.3 
2.3 


2.3 
2.4 


2.5 
2.4 


2.6 
2.3 


2.2 
2.4 


2.3 
2.6 


2.0 
2.2 


2.5 

12 


2.4 
2.5 


2.2 
2.3 


2.3 

• 


2.2 
2.5 


2.5 
2.7 


2.3 
2.4 


+=11 
+=4 -=^2 
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TABLE 5.24 (continued) 
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IT' 


]Z 


]i 


13 


29 


14 


17 


21 


22 


26 


li 


20 


23 


24 


25 


ii| 


28 


Means 


35 


pre 
post 


2.7 
2.7 


2.5 
2.2 


2.3 
2.5 


2.4 
2.6 


2.5 
2.5 


3.0 
3.1 


2.9 
3.1 


2.8 
2.8 


3.0 
3.0 


3.0 
3.1 


2.4 
2.6 


2.6 
2.7 


2.7 
2.7 


2.9 


2.8 
2.8 


2.8 
2.5 


2.7 
2.6 


+=3 -=7 


Item 36 


pre 
post 


3.3 
3.2 


3.2 
3.4 


2.8 
3.0 


3.0 
3.0 


3.0 
3.0 


3.0 
3.0 


3.2 
3.2 


2.9 


3.2 
3.1 




3.3 
3.0 


3.1 
3.1 


3.0 
3.3 


3.1 


3.2 
3.0 


2.9 
3.3 


2.9 
3.0 


+=4 


Item 37 


pre 
post 


2.3 
2.2 


2.5 
2.5 


2.5 
2.4 


2.5 
2.3 


2.7 
2.6 


2.4 


2.6 
2.8 


2.4 
2.4 


2.6 
2.6 


2.7 
2.9 


2.4 
2.1 


2.6 
2.5 


2.4 
2.4 


2.5 


2.5 
2.5 


2.5 
2.2 


3.0 
2.8 


1=8 —6 


Item 38 


pre 
post 


3.3 
3.8 


3.4 
3.2 


3.4 
3.6 


3.7 
3.6 


3.5 
3.5 


3.6 
3.8 


3.7 
3.6 


3.7 
3.7 


3.7 
4.0 


3.7 
3.5 


3.8 
3.9 


3.7 
3.3 


3.9 
3.5 


3.5 


3.7 
3.4 


3.5 
3.3 


3.5 
3.5 


+=8 -=4 


Item 39 


pre 
post 


2.7 
2.6 


3.0 
3.0 


2.5 
2.7 


2.8 
2.6 


2.6 
2.6 


2.9 


2.5 
2.5 


2.4 
2.6 


2.5 
2.7 


2.2 
2.1 


2.7 
2.2 


2.7 
2.7 


2.4 
2.5 


2.5 


2.5 
2.7 


2.7 
2.8 


2.4 

IJ 


+=7 

+=5 "=5 


Item 40 


pre 
post 


3.9 
4.0 


3.8 
3.5 


4.1 
3.8 


4.0 
4.0 


4.1 
3.9 


3.9 
4.0 


4.1 
4.1 


3.9 
4.0 


4.1 
4.0 


4.1 
4.1 


4.2 
4.3 


3.8 
3.7 


4.1 
3.9 


3.9 


4.0 
3.7 


3.8 
3.3 


3.9 
3.5 


=4 

+=9 


Item 41 


pre 
post 


4.2 
4.0 


4.0 
4.0 


3.9 
3.9 


3.9 
4.1 


3.9 
3.5 


3.9 
3.8 


4.1 
4.2 


3.5 
3.4 


4.0 
4.1 


4.2 
3.9 


4.2 
4.1 


4.0 
4.2 


4.3 
4.3 


4.0 


4.1 
3.8 


4.0 
4.1 


3.8 
3.6 


- 

+=8 



Underlined means indicate at least a .3 change between pre- and post-semester SAS means. Total +=93 +=127 

+= # of means for that item which increase between the pre- and post-semester surveys. 13^%J ^44%; 

+= # of means for that item which decrease between the pre- and post-semester surveys. .^gg 

-= # of means for that item which remain constant between the pre- and post-semester surveys. (24%) 
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which change by at least .3 are underlined. Overall in this section 44% 
of the means decrease, 32% increase, while remain the same. 

First, there are five items in which a majority of the means 
decrease. On Item 25 (As classes get larger I get less feedback on how 
well I understand the material during the semester), 11 of the 17 sets of 
means show a decrease. These decreases take the means from around 4 
(agree moderately) toward 3 (no opinion). Thus, while the students felt 
at the beginning of the semester they would get little feedback on their 
progress, many of them decided that they actually received more feedback 
than they had anticipated. 

On Item 26 (As classes get larger I feel less like a participant in 
the class), 10 of the 17 sets of means show a decrease. Even after the 
decreases, however, the means are still very close to 4 (agree 
moderately) so the students who changed their minds probably switched 
from 5 (agree strongly) to 4 (agree moderately). Participation of some 
type in class seems to be quite important to most students and many large 
class instructors have indicated in interviews that they tend to stifle 
it because they are afraid it will get out of hand. 

The response means to Item 30 (As classes get larger a good textbook 
and relevant outside readings become more important to my understanding 
of the content) show that 11 of the 17 sets decrease. Again, however, 
these decreases are usually quite small and the Post-semester means are 
all relatively close to 4 (agree moderately). 
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. On Item 31 (As classes get larger the pace of the course becomes 
less geared to the students' pace of learning), 10 of the 17 sets of 
means decrease. The means on the Pre-semester survey were centered 
around 4 (agree moderately) but on the Post-semester survey the me^ns 
were closer to 3.5 (no opinion). This change probably indicates that the 
students either found that it didn't matter if the course was paced to. 
their learning speed or that the instructors seemed to be attempting to 
individualize to some extent. 

Item 33 (As classes get larger I am less likely to know other 
students in the class) is the last one which shows a decrease in a 
majority of the mean pairs. The Pre-semester means hover around 3.6 - 
3.9 while the Post-semester means move toward 3.2 - 3.5. Evidently, more 
of the students disagreed with this statement at the end of the semester 
than had at the beginning. Perhaps they found that they actually did get 
to. know some of the other students, or, they found they were comfortable 
not knowing the person sitting beside them. 

The majority of the response means only increased on two items: 
Item 32 (As classes get larger I have more control over how involved I am 
in the class) and Item 34 (As classes get larger the material in the 
course can be covered more efficiently). On Item 32, 10 of the 17 sets 
of means show an increase. These increases move from 2 (disagree 
moderately) toward 3 (no opinion). This indicates that the students seem 
to have discovered that they can control their involvement in these large 
classes more than they thought they could. On the other hand, it may 
indicate that more of the students decided that it really didn't matter. 
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On Item 34, 11 of the 17 sets of means show an increase. Overall, 
however, these increases do not make much difference because the average 
Pre-semester mean (for all classes) is 2.3 and the average Post-semester 
mean is 2.4. Thus, the students still "disagree moderately" tlidt 'iV:: 
material can be covered more efficiently in large classes. 

Written comments . Quite a few of the students who filled out the 
SAS wrote additional comments in Section V about some of th'eir other 
feelings about large classes. These comments have been summarized and 
are listed below. The percentage of students responding whose statements 
could be categorized into each summary statement are also given. 

1. Large classes are "hazardous to your learning": 
first , they are impersonal, rigidly structured, 
p3orTy organized, and noisy; second , instructors 
who teach large classes are usually uncaring, 
inaccessible, boring, and give terrible tests 
with little constructive feedback on students 
performance; and third , students in large classes 
are competitive and sometimes lack integrity on 
tests. (19% of the 871 responding students) 

2. Instructors should possess good teaching 
techniques (e.g., leading class discussions, 
developing good evaluative instruments, using 
multi-media equipment effectively, and having _ 
more control over students' behavior in the 
classroom). (17« of the 871 responding students) 

3. A good class is determined by the effectiveness 
of the instructor. (11% of the 871 responding 
students) 

4. Instructors of large classes should devote more 
class time to discussions or should incorporate 
more discussion sections into the course. (8% of 
the 871 responding students) 
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Summary: Section IV. The data presented above for Section IV of 
the SAS indicate that studerits feel the quality of instruction in large 
classes is definitely determined by the instructor. Because of this they 
indicate that instructors who enjoy teaching and are concern'^d about the 
progress of the students make better large-class instructors. The 
governing (i.e., discipline) of a large class seems to be important too. 
Instructors who put up with noise, late-comers, talking during class, and 
cheating are not considered to be effective. There also seems to be a 
feeling that large classes, while they are not rated highly, can be 
improved if the instructors are trained in effectve teaching techniques. 

Direct Observation Data 

During each semeste- of the study an LCAP observer sat in on from 
one (1) to four (4) large classes. Each class was observed at least once 
a week and data were collected via the Expanded Cognitive Interaction 
Analysis System (CIAS). In addition, each observer collected copies of 
the homework assignments, quizzes, and exams which were used in the 
class. These were analyzed to determine the level of thinking (according 
to Bloom's Taxonomy of the Cognitive Domain) which was required in each 
course. The CIAS data were analyzed by overall means, by College, by 
instructor, and by course level. 
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CIAS Coding and Compilina Procedures 

The Expanded CIAS category system allows an observer to code the 
verbal interactions which occur in a classroom. Each verbal statement 
which is made is placed into one of 45 categories. A category is 
recorded every three seconds or when the interaction changes (whichever 
occurs first). Thus, in a typical 50-minute class an observer would 
record approximately 950 categories and in a 90-minute class 
approximately 1250 categories would be recorded. 

Because it would be almost impossible to generate and analyza a 45 x 
45 matrix, the subcategories were condensed into the original 10 
c.dtegories for data analysis purposes. Four of the subcategories which 
appeared to influence classroom climate and student enjoyment were then - 
extracted and coded as categories 11 (Humor), 12 (Use of visuals with 
lecture), 13 (Student questions), and 14 (Writing on board without 
talking) . 

To compile and analyze these data a computer program was developed 
with assistance from the Computition Center. After, the data were 
entered, the program generated the pe-cent of teacher talk (%TT) which 
took place, the percent of student talk (%ST), and a 14 x 14 matrix which 
showed the totals for each category as well as the percentage of the 
total tallies for each category (see Figure 5.1). The teachcr-talk 
categories consist of Categories 1-7, 11 and 12 while the student-talk 
categories consist of Categories 8, 9, and 13. (The numbers in the 
individual cells of the matrix a.-d the actual coding - which included all 
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Figure 5.1. Computer-generated CIAS Matrix. 
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the subcategories - were only used in our one-to-one consultations with 
the participant instructors and not in the anlysis which follows.) 

Overall mean percentages. The overall mean percentages for the 14 
CIAS categories are shown in Table 5.25 and Figure 5.2. As would be 
expected in a large university class, the bulk of the class time was 
spent in Categories 5 (Lecture) and 12 (Lecture with visuals). The 
interactions which occurred least frequently are represented by Category 
9 (Non-cognitive student talk) and Category 7 (Criticism). The total 
repr-esented by Teacher Talk categories is 88.46% of the class time; the 
total represented by the Student Talk Categories is 5.02X o'f the class 
time; and, the total represented by the Silence Categories is 6.36% of 
the class time. Thus, overall, the amount of student participation is 
quite limited. 

By college. The CIAS mean percetages by College are given in Table 
5.26 and graphed in Figure 5.3. Though the mean percentages are quite 
small for Category 1 (Accepting student attitudes), the instructors in 
the College of Business use verbal statements of this nature more 
frequently (1.14) than do those in the other colleges. The instructors 
in the College of Engineering use this type of verbal statemeant less 
than .1% of the time. (Statements which would be included in this 
category are those such as —"I understand that this section is somewhat 
more difficult than the previous sections, but I'm sure it will become 
clearer as we go along"; or "You seem a little anxious about the 
upcoming exam..."). Note: Because there were only two instructors from 
the College of E ;gineering who volunteered to let an observer attend 
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TABLE 5.25 
Overall Means for CIAS Categories 



Teacher Talk 
Category 


Mean 


Student laiK 
Cateqoiry 


Mean 


Si 1 ence 
Category 


Mean 


1 
1 




8 


2.93 


10 


5.03 


9 


99 


9 


.03 


14 


1.33 


3 


2.18 


13 


2.06 


Total 


6.36 


4 


3.12 


Total 


5.02 






5 


52.59 




« 








8.94 












.04 










11 


.90 










12 


18.93 











Total 88.46 



I - Acceotinq student attitudes 

0 PnciHve reinforcement; affective instructor comments ^ 

3 : RfplalingTrtudenr^^^^^ providing corrective feedback; building 

on a student response 

4 - Questions asked by instructor 

6 - ProJiding cues; focusing on main points; giving directions; assign- 

ments, process 

7 - Criticism 

8 - Cognitive student talk 

9 - Non-cognitive student talk 

10 - Silence; listening or watching 

II - Teacher use of humor 

12 - Simultaneous visual and verbal presentation 

13 - Student question 

14 - Writing on board without talking 
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Figure 5.2 

Overall percentage mean' for CIAS Categories 
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Category 



2 - 

3 • 



Accepting student attftudes 
Positive reinforcement; 
affective instructor comments 
Repeating a student response; 
providing corrective feedback; 
building on a student responjfe 
Questions asked by instructor 
Lecture 

Providing cues; 
focusing on main points; 
giving directions^ asslghmentst 
process 



7 • Criticism 

8 - Cognitive student talk 

9 • Non-cognitive student talk 

10 « Silence; listening or watching 

11 - Teacher use of humor 

12 - Simultaneous visual and verbal 

presentation 

13 - Student question 

U - Writing on board without talking 
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TABLE 5.26 
' CIAS Means by College 





Nat. Scl . 


EnQineerIng 


Business 


Liberal Arts 


1 


.69 


.096 


1.14* 


.83 


2 


.95 


.68 


.99 


1 .08* 


3 


.1.22 


4.09* 


1.33 


2.86 


4 


3.21 


2.10 


3.33*, 


3.25 


5 


42.20 


36.10 


60 . 20* 


59.90 


6 


9.76 


10.61* 


8.12 


8.38 


7 


.03 


.19* 


.04 


.009 


8 


1.63 


1.92 


2.56 


' 4.36* 


9 


.02 


.01 


.07* 


.02 


10^ 


2.98 


10.75* 


. 5.04 


4.86 


11 


.71 


.50 


1.29* 


.92 


12 


33.31^ 


29.18 


13.27 


8.61 \ 


' 13 


1.07 


2.76* 


2.39 


2.29 


14 


12.83* 


1.04 


.04 


1.61 



*H1ghest mean percentage for each CIAS Category. 

1 - Accepting student attitudes 

2 - Positive reinforcement; affective Instructor comments 

3 - Repeating a student response; providing corrective feedback; building 

on a student response 

4 - Questions asked by Instructor 

5 - Lecture 

6 - Providing cues; focusing on main points; giving directions; assign- 

ments, process 

7 - Criticism 

8 - Cognitive student talk 

9 - Non-cognitive student' talk 

10 - Silence; listening or watching 

11 - (Ih) - Humor 

12 - (5v) - Visual and verbal presentation 

13 - (8q) - Student question 

14 - (10b) - Writing on board without talking 
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their classes, the results obtained for this College may not be 
representative of the College as a whole. 

t 

i 

C. 4 

Category 2 (Posit'ive reinforcettlent; affective 'instructor coinments)% ' 
is used most frequently by the instructors in the'college of Liberal/rts 
(1.08). However, as can be seen in Figure 5.3(b) there, is not a great 
deal of diffeence among the colleges. Again, the instructors in the 
College of Engineering use this type statement less frequently." ^ , 

In Figure 5.3(c) the mean percentages for Category 11 CHumor) are 
graphed next. The use of humor in the classroom *is a means of -putting 
the students at ease and is listed frequently by students as a 
characteristic of effective teachers (Eble. 1974; Sheffield. 1974;^Ebro.; 
1977). However, even tHough the instructors in the College of Business 
use humor more than do the instructors in the other colleges, they still 
only use it 1.29* of the time. 

r 

The reader should note that the scale for Category 3 (Repeating a . 
student response; providing corrective feedback; building on a student 
response) in Figure 5.3(d) is different than that for Categories 1 and 2. 
The instructors in Engineering use this type statement quite a bit more 
(4.09) than do those instructors in the other colleges. For the most 
part, the statements used by the instructors in Engineering which were 
coded as 3's consisted of repeating a student's response. This was doue 
to let the student know his/her response was acceptable and also to make 
sure the other students in the class heard the response. 
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Figure 5.3 (a, b, & c) 
Mean percentages for each CIAS category by college 
Category 1 Category 2 




NS E B LA . NS E B LA 

(a) (b) 



Category 1 - Accepting student attitudes Category 11 

Category 2 - Positive reinforcement; 
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Figure B.3 (d & e) 
Mean percentages for each CIAS category by cc>Uege 



1 

Category 3 Category 4 

5.0* 




Category 3 - Repeating a student's response; providing corrective feedback 
building on a student's response 

Category 4 - Questions asked by instructor 

NS - Natural Science 
E - Engineering 
B - Business 
LA - Liberal Arts 
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Category 4 (Questions asked by Instructor) 1s used with about the 
same frequency by all of the Instructors who were observed (Figure 
5.3(e)). The instructors in Engineering seem to ask fewer questions, but 
this may not be a very valid statement because the sample from this 
college is quite small. When the observers coded a Category 4, they also 
determined the specific type of question which was being asked. The 
subcategories for Category 4 and the percentage of each type question 
which was used in each college a»^ given U Table 5.27. As indicated by 
the asterisks (*), the most frequently asked questions are those which 
deal with process/structure (4s) - i.e., "Do you need more time?" "Does 
everyone have a copy of the handout?" - or those which are rhetorical 
(4r). The instructors in the Natural Sciences and Engineering focused 
more on knowledge/comprehension (4c) level questions while those in 
Liberal Arts asked more higher level (4a - Analysis, 4y - Synthesis, 4j - 
Evalfiation/Judgment) and probing (4p) questions. Students are called on 
individually to respond (4d) most frequently by the instructors in the 
College of Business. One somewhat surprising result is that the 
instructors in business asked affective questions (4f) more frequently 
than the others. (Several examples of an affective question would be: 
"Do you like this example?" or "How do you feel about large classes?"). 
Overall, as we had hypothesized, most of the questions dealing directly 
with the content only required the students to respond at the 
knowledge/comprehension level. 

The mean percentages for Category 8 are graphed next in Figure 
5.3(f) so the student response rate can be compared with the questioning 
rate. Though the instructors all ask approximately the same number of 
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TABLE 5.27 

Percentage of Types of Questions Asked During Class by College 



Question 

v^uuc 


NS 


E 


• 

B 


LA 


AVG 


4c 


21.7 


16.6 


C 0 


in ft 


13.8 


4e 


8.3 


0 c 
C,0 


b • o 


2.8 


4.1 


4a 


2.0 


1 c 

1 ,0 


7 


12 2 


4.9 


4y 


0.0 


0.0 


0.0 


1.1 


0.3 


4j 


0.0 


0.1 


0.0 


1.7 


0.5 


4f 


0.0 


0.0 


2.6 


0.9 


0.7 


4s 


26.9 


' 32.9* 


28.4* 


' 13.1 


25.3 


4r 


37.9* 


31.0 


22.0 


32.5* 


30.9 


4p 


2.9 


14.7 


15.5 


• 16J. 


• 12.3 


4d 


0.4 


0.7 


18.8 . 


8.3 


7.1 



Underlined #s indicate highest percentage for that Category. 
*Highest percentage for that College. 
Question codes: 
4c - Knowledge/Comprehension 

4e - Application 

4a - Analysis 

4y - Synthesis 

43 - Evaluation/ Judgment 

4f - Affective 

4s - Process/Structure 

4r - Rhetorical 

4p - Probing 

4d " Calling on student 
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Figure 5.3 (f & g) 
Mean percentages for each CIAS category by college 
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Category 13 
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(f) 



(g) 



Category 8 - Cognitive student talk Category 13 - Student question 

NS - Natural Science 
E - Engineering 
B - Business 
LA - Liberal Arts 
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questions, the students 1n Liberal Arts seem to be given more opportunity, 
to respond and/or to respond at length. This phenomenon can be explained 
by the data we saw in Table 5.27 which shows that the instructors in 
Liberal Arts asked more questions which required higher level thought 
processes (4a, 4y, 4j). 

Student questions (Category 13) are graphed next in Figure 5.3(g). 
We see here that though the instructors in Engineering asked fewer 
questions than did those in the. other colleges, they allowed students to 
ask questions more frequently. The students in the Natural Sciences 
either did not have many questions or were discouraged from asking them 
by their instructors. 

Category 10 (Silence) percentages are shown next in Figure 5.3(h). 
The large amount of silence found in Engineering classes, when compared 
with the silence occurring in the other colleges, is accounted for by the 
fact that the Engineering instructors gave frequent, short in-class 
quizzes at the beginning of their classes while the others did not. 

The instructors in the Natural Sciences write on the board/overhead 
without talking (Category 14) much more than the instructors in the other 
colleges (Figure 5.3(i)). The classes in the Natural Sciences which were 
observed consisted of two chemistry classes, one math class, one 
astronomy class, and one home economics class. Evidently, in these 
courses the instructors frequently present problems and/or formulas which 
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Figure 5.3 (h, i, & k) 
Mean percentages for each CIAS category by college 



Category 10 



Category 14 



ico- 



ns 

£ 

0) 
O) 
ro 
-M 
C 

a> 
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Oi 




B LA 



(h) 



Category 10 - Silence; listening 
or watching 



Category 5 




(j) 

Category 5 - Lecture 

NS - Natural Science 
E' - Engineering 
B - Business 
LA - Liberal Arts 




B U 



Category 14 - Writing on board without 
talking 

Category 12 




Category 12 - Simultaneous visual and 
verbal presentation 
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are written on the board/overhead for the students to copy into their 
notes. 



The reader should note that the scales on Category 5 (Lecture) and 
Category 12 (Lecture with visuals) are quite different from those for the 
previous categories (i.e., each segment represents a larger % change). 
(See Figures 5.3(j)(k).) The interactions represented by these two 
categories are the ones which appear to be used most often in large 
lecture courses. When mean percerstages for these categories ar9 compared 
by college we note that the instructors who lecture straight (i.e., 
without the aid of visuals) less (Category 5) tend to lecture with 
visuals more (Category 12). Thus, the total mean percentage of time 
spent lecturing for each college is as follows: NS - 75.5156, E - 65.28%, 
B - 73.47%, and LA - 68.51%. 

Statements which are coded as Category 6 (Providing cues; focusing 
on main points; giving directions; assignments, process) were used with 
relative frequency by all of the instructors; though, those in 
Engineering and Natural Science used them more frequently than did the 
instructors in Business and Liberal Arts (Figure 5.3(1)). Statements 
which are coded into this category provide assistance to the students in 
their note-taking by pointing out important points and providing cues to 
new wordspr concepts. 

Though statejnents of criticism (Category 7) were used very 
infrequently (Figure 5.3(m)), the instructors in Engineering used them 
quite a bit more than the others. (Again, however, these results must be 



Figure 5.3 (1, m, & n) 
Mean Percentages for each CIAS category by college 



Category 6 



Category 7 




NS E B LA 



C 

a. 




(1) 



(m) 



Category 9 




NS E B LA 



(n) 



Category 6 - Providing cues; focusing 
on main points; giving 
directions, assignments, 
process 

Category 7 - Criticism 

Category 9 - Non-cognitive student talk 

NS - Natural Science 

E - Engineering 

B - Business 

LA - Liberal Arts 



115 

133 



looked at with the small sample size for Engineering In mind. This may 
not be representative of the College as a whole.) 

Finally, non-cognitive student talk (Category 9), occurred very 
infrequently. As Is Indicated In Figure 5.3(n) however, the students In 
Business engage in this type of talk more frequently than do the students 
In the other colleges. In comparing the graphs for Category 7 and 
Category 9, there seems to be little relationship between the amount of 
criticism used by an Instructor and the amount of non-cognitive student 
talk recorded. The College of Engineering shows the least non-cognitive 
student talk and the most criticism while the College of Business shows 
the most non-cognitive student talk and the second-highest amount of 
criticism. 

By instructor. The mean percentages for each CIAS category by 
instructor are shown In Table 5.28. The highest mean percentage for each 
category is underlined. These mean percentages are also graphed in 
Figure 5.4(a-p). 

The average percentages of teacher talk (Category 1-7, 11 and 12) 
per instructor are shown first in' Figure 5.4(a). Here, though 1t appears 
that there is not a great deal of difference among the Instructors In the 
amount of time they spend talking, the range for their average 
percentages Is from 79. 3X for Instructor #13 to 98.0% for Instructor ^^^20. 
In a 50-minute class this 18. 7X difference would amount to 9.4 minute 
while In an 80-minute class It would be 15 minutes. 
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T«b1« 5.28 

Mt«n P«rceAt«9«s for CIAS Ute^orlii by Instructor 



Inttructor 






NS 








E 


B 


LA 


Code 


11 


12 


15 


la 


1ft 




13 


29 


14 


17 


21 


22 




16 


^0 


23 


24 


25 


27 


26 


11119th of 






























50 


80 


50 


50 


80 


80 


CliSS (Ml A.) 


SO 


80 


SO 


50 


50 




80 


SO 


^80 


80 


80 


80 


60 


60 


AV9. % TT 


96.1 


95.4 


85.1 


96.9 


91 


.3 


79.3* 


69.1 


94.7 


79.4 


96.1 


82.2 


94.8 


92.7 


98.0 


65.5 


65.4 


79.9 


80.5 


66.3 


Avg. t ST 


2.4 


4.1 


3.7 


1.03* 


2 


.1 


6.1 


3.6 


5.0 


9.2 


2.1 


5.7 


4.4 


3.2 


1.3 


11.6 


5.5 


10.4 


7.7 


8.5 


f StMdintt 


140 


200 


130 


300 


300 




140 


2S0 


120 


140 


200 


m 


110 


130 


300 


120 


200 


220 


90* 


130 












































1 


2.2 


0.8 


0.07 


0.6 


0 


.1 


0.02* 


0.2 


1.0 


0.1 


1.9 


0.1 


2.2 


0.1 


ill 


0.9 


0.2 


0.1 


0.1 


0.1 


2 


2.5 


1.4 


0.9 


0.3* 


0 


.5 


0.6 


0;9 


0.3* 


3.0 


1.8 


1.1 


0.8 


1.1 


0.4 


0.7 


1.5 


0.9 


0.9 


2.4 


a 


1.4 


2.4 


0.7 


0.3 


I 


.4 


5.9 


1.7 


2.4 


0.1* 


1.4 


0.3 


2.2 


2.6 


0.4 


6.6 


4.0 


3.3 


2.5 


0.5 


* 

4 


1.2* 


4.4 


3.5 


1.2* 


5 


.3 


2.7 


1.3 


2.9 


2.4 


id 


,2.3 


1.9 


6.5 


1.5 


5.6 


2.1 


4.3 


1.9 


2.6 




67.3 


62.9 


20.2* 


33.3 


46 


.1 


44.7 


24.6 


67.0 


61.7 


57.1 


60.1 


63.7 


62.9 


80,2 


34.2 


63.2 


63.6 


54.1 


70.1 


6 


10.2 


11.5 


10.7 


8.5 


8 


.3 


8.6 


1L2 


5.4* 


8.6 


9.0 


7.6 


9.6 


8.1 


9.5 


7.0 


9.5 


6.9 


9.4 


5.6 


7 


0.02 


0.0 


0.04 


0.07 


0 


.01 


0.3 


0.0 


0.0 


0.1 


0.01 


0.12 


0.0 


0.0 


0.04 


0.03 


0.0 


0.0 


0.0 


0.0 


8 


1.2 


2.8 


2.1 


0.05* 


1 


.8 


2.6 


1.04 


2.5 


3.3 


1.5 


1.1 


3.2 


2.8 


0.5 


9.0 


4.3 


5.4 


4.1 


5.1 


9 


0.0 


0.0 


0.01 


0.0 


0 


.01 


0.02 


0.0 


0.0 




0.0 


OJ 


0.0 


0.0 


0.0 


0.0 


0.0 


0.1 


0.01 


0.0 


10 


1.4 


0.2 


6.2 


0.1* 


4 


.8 




5.1 


0.3 


11.3 


1.8 


12.1 


0.7 


2.U 


0.6 


0.7 


8.3 


8.3 


7.5 


4.7 


11 


0.1 


0.9 


0.8 


0.08* 


0 


.7 


0.6 


0.3 


0.9 


1.1 


0.6 


2.5 


1.2 


0.2 


1.7 


0.1 


0.3 


1.3 


0.4 


1.6 


12 


10.3 


21.8 


48.2 


52. 5 


28 


.9 


15.6 


46.8 


14.9 


12.3 


19.0 


8.1 


13.2 


12.2 


0.1* 


29.5 


4.7 


2.1 


11.3 


3.5 


13 


1.3 


1.2 


1.3 


1.0 


1 


.4 


3.0 


2.5 


2.6 


3.6 


0.6 


4 J 


1.2 


0.4* 


0.9 


2.6 


1.2 


4.4 


3.6 


3.4 


14 


0.03 


0.3 


5.3 


1.9 


1 


.8 


0.1 


2.3 


0.0* 


0.2 


0.05 


0.04 


0.0* 


2.^ 


0.04 


2.3 


0.9 


1.3 


4.3 


0.5 



Underlined percentige neins tndtcete htgliest percent for th«t Citegory. 
HoHtst percent for thit citegory. 
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Figure 5.4(a). Average percentage of Teacher ^alk per instructor, 
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Figure 5.4(b). Average percentage of Student Talk per instructor. 
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The average percentages of student talk (Category 8 and 9) pe 
•instructor are graphed next (Figure 5.4(b)). This shows that the 
^students In Instructor #23*s class participated an average of 11.6% of 
. the 'time (Since this class met on Tuesday/Thursday, that means the 
stuc' nts spent an average of 9.3 minutes verbally participating.) It Is 
Interesting to note (though not unreasonable to expect) that as the 
average class size decreases, the amount of student participation 
increases: 

NS i i LA 
Avg. Class Size 2U 195 184 170 

Avg. X Student Talk 2.7 4.3 5.3 6.9 

Avg. # minutes in T/T class 2.2 3.4 4.2 5.5 
Avg. # minutes In MWF class 1.4 2.2 2.7 3.5 

This Indicates that the goal of having a great deal of verbal student 
participation may not , be readily attainable (or desirable?) in large 
classes. 

» 

The percentage means for each instructor on Category 1 (Accepting 
student attitudes) are given in Figure 5;4(c). Instructor #20 uses 
statements which are coded in this category more frequently (4.2%) than 
do the other Instructors. Perhaps this indicates that it is difficult to 
make statements of this type when one does not know the students very 
well. It would be informative to compare the percentage of use of 
Category 1 statements in smaller classes to that observed in this study. 

Each instructor's use of Category 2 (Positive reinforcement; 
affective Instructor comments) is graphed in Figure 5.4(d). Instructors 
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Figure 5.4(c). Percentage means for Category 1 (Acrepting student 

attitudes) by instructor. — 
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Figure 5.4(d). Percentage means for Category 2 (Positive reinforcement; 

affective instructor comments) by instructor. 
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#11, #17, and #2^ use statements ^^^^^^ frequently than do 

the other Instructors. Even so, these Instructors only use positive 
reinforcement 2.5X, 3.0X, and ZA% of the time respectively. Of course, 
there usually must be student participation before an Instructor can use 
reinforcing statements. And, since there is little student participation 
in these large classes, there are few opportunities to use direct 
reinforcement. 

The mean percentages for Category 3 (Repeating a student response; 
providing corrective feedback; building on a student response) are 
graphed in Figure b.4(e). Instructors #13 ana #23 use statements of this 
nature quite frequently while Instructor #17 uses them very rarely. For 
the most part, the statements which occur most often under this category 
consist of "instructor reptition of a student's response". Statements 
which provide corrective feedback and build on .a student's response are 
not heard frequently in large classes. 

The mean percentages for each Instructor for Category 11 (Use of 
humor) are presented next (Figure 5.4(f)). As can be seen, humor is not 
used frequently in large classes. Even Instructor #22, who uses humorous 
statements most frequently, only spends about 2.5% of the time making 
humorous statements. (This equals approximately two minutes each class 
period in a Tues./Thurs. class.) 

A graph of the mean percentages for Category 4 (Questions asked by 
the Instructor) is presented next in Figure 5.4(g). Here we see that 
Instructor #21 asked questions more freqently (6.7%) than the other 
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Figure 5.4(e). Percentage means for Category 3 (Repeating a student response; 

providing corrective feedback; building on a student response) 
by instructor. 
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Figure 5.4(f). Percentage means for Category 11 (Use of humor) by instructor, 
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Figure 5.4(g). Percentage means for Category 4 (Questions asked by the 

instructor) by instructor. 
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instructors. This averages approximately 5.4 minutes per class period 
spent asking questions (in a Tues./Thurs. class). 

If the mean percentage for Instructor #21 for Category 4 is compared 
with that of Category 8 (Cognitive student response - Figure 5.4(h)), one 
can assume that most of the questions which were asked were of a 
rhetorical nature. This assumption can be made because though a numbc-r 
of questions were asked, very little time was recorded (1.5%) as being 
spent in student responses. On the other hand. Instructor #23 spent an 
average of 5.6% (or 4,5 minutes) of the time asking questions and student 
responses encompassed an average of 9.0% (or 7.2 minutes) of the time. 
This indicates that some of the questions which were being asked required 
higher level thinking and, consequently, longer student responses. We 
can also note from Figure 5.4(h) that most of the instructors in Liberal 
Arts allowed relatively more frequent student participation than did the 
instructors in the other colleges. 

Category 13 (Student questions) provides us with additional 
information concerning the participation level of the students. Figure 
5.4(i) shows the mean percentages for this category. Here we find that 
Instructors #22 and #25 allow student questions more frequently (4.5% and 
4.4% respectively) than do the other instructors, while Instructors #21 
and #16 allow student questions least frequently (0.6% and 0.4% 
respectively). The level of student questions was relatively equal in 
all of the classes in Natural Science while there was quite a bit of 
variation in the classes in Business and Liberal Arts. This may indicate 
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Figure 5.4(h). Percentage means for Category 8 (CognUive student response) 

by instructor. 
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Figure 5.4(i). Percentage means for Category 13 (Student questions) by 

instructor. 
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Figure 5.4(j). Percentage means for Category 10 (Silence) by instructor. 
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the use of very similar teaching styles by the instructors in Natural 
Science. 

Figure 5.4(j) shows the mean percentages for Category 10 (Silence). 
Instructor #13 gave frequent in-class quizzes which probably accounts for 
the relatively high amount of silence {15,1% or about 12 min.) found in 
this class. On the other hand, there was virtually no silence (0,1% or 
about ,5 min,) in Instructor #18 's classroom. Often the only time 
complete silence occurs in large university classrooms is when the 
students are working on a quiz or problem at their seats or after the 
instructor has asked a question and is giving them time to develop a good 
answer before calling on someone to respond. Otherwise, silence occurs 
fairly infrequently. 

Another category of silence which was added to the basic 10 
categories consists of time when the instructor is writing information on 
the board or overhead transparency but is not talking at the same time. 
This activity is represented by Category 14 (Figure 5,4(k)), The 
phenomenon of writing on an overhead or blackboard without talking seems 
to be foreign to the instructors in Business, Many of them use slides as 
information disseminators rather than overhead transparencies or the 
blackboard so this category would not be a useful descriptor of their 
teaching techniques. We can see that Instructor #15 spends more time in 
this teaching mode (5.3% or about 2,7 min,) than do the other 
instructors. Overall, however, this method is not used very frequently 
in the large classes observed in this study. 
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Figure 5.4(k). Percentage means for Category 14 (Writing on board or 

transparency without talking) by Instructor. 



Key 



Natural Science CD Encineering El Business ^ Liberal Arts 



ERIC 



146 



The most frequently used verbal activity in large classes is 
represented by Category 5 (Lecture). As we can see in Figure 5.4(1) the 
amount of time spent in just giving out information varies from a low of 
20. 2X or 10 min. in Instructor #15's class to a high of QO,Z% or 40 min, 
in Instructor #20' s class. (These are both MWF classes of 50 min. each.) 
On the average, however, these instructors spent from 4056 to 60% of the 
class time lecturing; that is 20-30 minutes in a MWF class and 32-48 
minutes in a TTh class. 

Category 12 (Lecturing with visuals) is also information 
dissemination, but the instructor focuses the students' attention on a 
visual while continuing to lecture (see Figure 5.4(m)). If we look at 
the mean percentage for Instructor #15 in this category (52.5% or 26 
min.), we can readily see why the mean percentage in this class for 
Category #5 was quite lew. If we add these two means together we find 
that Instructor #15 lectured with and without visuals a total of 7Z,7% or 
36.4 minutes. On the other hand. Instructor #20's percentage mean for 
Category 12 is only 0,1% but when this is added to his mean percentage 
for Category 5 (80.2%) we find that this instructor lectured an average 
of 80.3% of the time or 40.2 minutes. 

The verbal statements represented by Category .6 (Providing cues; 
focusing on main points; giving directions, assignments, process) provide 
the students with guidelines for their note-taking and assessment of the 
relevancy of what is being said by the instructor. Yet, in many of the 
classes which were observed for this study statements such as these are 
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Figure 5.4(1). Percentage means for Category .5^ (Lecture) by instructor. 
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Figure 5.4{m). Percentage means for Category 12 (Lecturing wit.i visuals) 

by instructor. 
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not used very frequently (see Figure 5.4(n)). The average use of these 
statements ranges from a low of 5.4% of the time or 4.3 minutes in 
Instructor #14's class to a I igh of U.2% of the time or 6.6 minutes in 
Instructor #29's class. , It is interesting to note that more of the 
instructors in Natural Science and Engineering use these types of 
statements than do those in Business or Liberal Arts. Perhaps this is 

r 

due to the technical nature of the subjects taught in the two former 
colleges, which require more cues and directions for student acquisition 
of the material. 

In looking at Figure 5.4(o) we see that Criticism (Category 7) is 
used very infrequently in large university classes. Even though it 
appears that Instructor #13 uses criticism frequently, the actual mean 
percentage of time spent criticizing is only 0,3% or about .2 minutes. . 
It is frequently assumed that the larger the class the more the 
instructor has to discipline. -However, the data gathered .in this study 
show no relationship between the class size and the amount of criticism 
used by the instructor. For example, Instrtictor #13 uses the most 
criticism but this class only had 140 students. On the other hand. 
Instructor #22 had the largest class (350 students) but used criticism 
0.12% of the time or about .1 minute per class session. There seems to • 
be We of a tendency for instructors in Natural Science to use criticism 
in their classes than for those in Liberal Arts. This may be because 
instructors who are in the sciences are typically more authoritarian than 
those who are in Liberal Arts or it may be uje to the different types of 
course content which are being presented. Of course, these are only 
speculations and cannot be "proven" without additional study. 
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Figure 5.4(n). 



Percentage means for Category 6 (Providing cues; focusing 
on main points; giving directions; assignments, process) 
by instructor. 
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Figure 5.4(o). Percentage means for Category 7 (Criticism) by instructor. 
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The final category which is graphed in Figure 5.4{p) is Category 9 
(Non-cognitive student talk). Statements which are coded into this 
category consist of statements made by students which have nothing to do 
with the content (e.g., "Can we have a break?", "What time is it?", "Do 
we have to hear this again?"). As one would expect, there is really very 
little non-cognitive student talk which occurs in university classes; 
even in the large ones. Figure 5.4(p) indicates that Instructors #17 and 
#22 have the most non-cognitive student talk occurring in their classes 
(u.2% or .16 minutes). This may be why they use more criticism (Fig. 
4.4(o) - Category 7) than most of the other instructors. For most of the 
instructors, however. Category 9 is not recorded at all. 

By instructor - first half vs. last half of semester . One of the 
goals of this study was to discover whether the verbal interactions of 
the instructors changed over time. To do this, we compared the CIAS 
category mean percentages from the first half of the semester with those 
of the last half. The mean percentages f^r- this are presented in Table 
5.29 and graphed in Figure 5.5(a-n). 

As we can see in Figure 5.5Ca) most of the instructors increased 
their use of Category 1 (Accepting Student attitudes) from the first half 
of the semester to the last half. Instructor #20 used statements of this 
nature more than twice as frequently during thfejdst half of the semester 
(2.6X - 1st half; 5.6X - 2nd half). Overall, however, statements which 
are coded into this category seem to be used quite infrequently in large 
classes. 



/ 



.25 
.20 ■■ 
.15 
.10 + 
.05 



• • * 

• 

• • 




1 

• * • * 

• • *• 

• 1 • 

• 

• 


• * • 




• • . 
• 

• • 

t • 
• • 








* • * 

• • • • 




• ■ 


• • 






• 







-I- 



11 12 15 18 19 



13 29"'^14 17 21 22 26 16 20 23 24 25 27 28 
Instructor Codes 



Figure 



5.4(p). Percentage means for Category 9 (Non-cognitive student 
talk) by instructor. 
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TABLE 5.29 

Mean Percentages for CIAS Categories by Instructor 
1st half of semester vs. 2nd half of semester 



NS 



Category 


11 

a b 


12 

a b 


15 

a b 


18 

a b 


19 

a b 




13 

a b 


29 

a b 


1 


2.6 


1.8 




.88 


.75 




.06 


.08 




.56 


.62 




0.0 


.23 




.02 


M)l 




20 


20 


2 


2.3 


2.6 




.88 


.53 




.44 


1.14 




.48 


.14 




.40 


.55 




62 


51 




56 


1 14 


J 


2.4 


.52 




2.9 


1.8 




.58 


.81 




.46 


.22 




2.3 


.90 




2.8 


7.9 




2 1 


1 3 


M 

H 


1.0 


1.3 




4.6 


4.0 




2.8 


3.9 




1.6 


.78 




6.2 


4.7 




3.8 


2.0 




1.2 


1.4 


5 


62.8 


71.7 




50.1 


56.5 




20.0 


20.3 




30.4 


36 2 




53 3 


41 6 




47 1 


43 2 




24 1 


25 5 


6 


13.4 


7.1 




12.2 


10.6 




10.6 


10.7 




11.6 


5.4 




7.1 


9.0 




7.3 


9.5 




14.1 


12.2 




.02 


.02 




0.0 


0.0 




0.0 


0.06 




.14 


0.0 




.02 


0.0 




.08 


. .49 




0.0 


0.0 


8 


1.5 


.90 




3.7 


1.8 




l.C 


2.3 




.10 


0.0 




2.2 


1.6 




3.2 


2.2 




1.3 


.76 


G 9 
at 


0.0 


0.0 




0.0 


0.0 




0.0 


.11 




0.0 


0.0 




0.0 


.01 




0.0 


.04 




0.0 


0.0 


10 


0.0 


2.8 




.12 


.38 




5.0 


6.9 




.o2 


.24 




4.8 


4.8 




13.2 


16.3 




4.6 


5.7 


11 


1.4 


.56 




1.1 


.58 




.82 






.08 


.08 




J90 


.61 




.52 


.73 




.32 


.28 


12 


11.4 


7.1 




22.0 


21.6 




51.8 


46.2 




51.8 


53.3 




21.4 


33.6 




18.9 


13.6 




46.7 


46.9 


13 


.92 


1.6 




1.2 


1.2 




.88 


1.5 




1.5 


.48 




.14 


.45 




2.3 


3.4 




3.2 


1.8 


14 


.06 


0.0 




.32 


.25 




5.4 


5.2 




1.3 


2.5 




1.4 


2.0 




.14 


.09 




1.7 


2.8 



Underlined values indicate a fairly significant change between the 1st half and the 2nd half of the semester 
in the mean values. 
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Table 5.29 (con't) 

B 



Category 


14 

a b 


17 

a b 


21 

a b 


22 

a b 


26 

a b 


1 




• 77 




• 04 


• 10 




K3 


2.5 




0.0 


.24 




2.4 


2.1 


2 


28 


27 










Id 






on 

.yu 


1 .J 




. /6 


/ 

GO 

.82 


3 


3.1 


i.2 




.20 


0.0 




1.9 


1.0 




.28 


.36 




2.5 


1.9 


4 


3.3 


2.2 




1.8 


3.8 




6.2 


7.3 




2.1 


2.5 




1.9 


'l.9 


5 


62.3 


74.7 




52.4 


50.1 




57.1 


57.1 




67.5 


52.7 




60.0 


67.4 


6 


6.8 


■3.0 




8.1 


9.9 




9.3 


8.7 




7.8 


7.4 




11.9 


7.3 


7 


0.0 


0.0 




.04 


.15 




.02 


0.0 




.10 


.14 




0.0 


0.0 


8 


3.2 


1.2 




4.4 






1.7 


1.3 






1.1 




3.3 


3.1 


9 


0.0 


0.0 




.14 


.45 




0.0 


0.0 




0.0 


.32 




0.0 


0.0 


10 


.28 


.23 




13.8 


4.9 




1.8 


1.9 




6.1 


18.1 




.90 


.52 


11 


1.2 


.40 




1.4 


.35 




.60 


.60 




3.4 


1.6 




.98 


1.4 


12 


15.1 


11.2 




11.6 


14.2 




19.4 


18.5 




7.2 


8.9 




14.2 


12.1 


13 


3.2 


1.5 




2.9 


5.5 




.48 


.70 




3.4 


,5.5 




1.0 


1.4 


14 


0.0 


0.0 




0.0 


.55 




.08 


-.02 




.06 


.02 




0.0 


0.0 



Underlined values indicate a fairly significant change between the 1st half and the 2nd half 
of the semester in the mean values. 
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Table 5.29 (con't) 



Category 


16 

a b 


20 

a b 


23 

a b 


24 

a b 


25 

a b 


27 

a b 


28 1 
a b 


1 


.18 


0.0 




2.6 


5.6 




.54 


1.24 




.02 


.29 




.08 


.10 




.12 


.08 




.10 


.12 


2 


.92 


1.3 




.10 


.57 




.64 


.68 




1.5 


1.5 




1.3 


.52 




.90 


.88 




1.9 


2.8 




2.2 


3.2 




.62 


.27 




6.8 


6.3 




1.2 


5.7 




2.6 


4.0 




1.3 


3.5 




.60 


.43 


4 


4.1 


7.3 




1.5 


1.6 




6.2 


5.1 




2.0 


2.1 




6.6 


2.4 




2.1 


1.7 




2.6 


2.6 


5 


64.6 


60.8 




83.7 


77.2 




40.1 


28.4 




65.5 


61.8 




56.0 


61.6 




57.6 


51.2 




64.4 


73.3 


6 


9.6 


6.3 




7.8 


11.0 




8.2 


5.8 




7.6 


10.7 




8.6 


9.0 


• 


9.9 


8.9 




6.7 


4.6 


7 


0.0 


0.0 




0.0 


.07 




.06 


0.0 




0.0 


0.0 




0.0 


0.0 




0.0 


0.0 




0.0 


0.0 


8 


2.5 


3.1 




.56 


.37 




9.0 


8.9 




2.2 


5.7 




6.1 


4.9 




4.2 


4.0 




4.3 


5.7 


9 


0.0 


0.0 




Q.O 


.03 




0.0 


0.0 




0.0 


0.0 




.14 


.03 




.02 


0.0 




0.0 


0.0 


^ 10 


1.9 


2.3 




.52 


.63 




.52 


.62 




14.0 


4.7 




7.5 


9.0 




6.2 


8.6 




9.8 


.52 


CO 11 


.30 


.13 




1.6 


1.7 




.72 


1.2 




.16 


.44 




1.8 


.97 




.20 


.53 




1.8 


1.4 


12 


12.1 


12.3 




.10 


.10 




22.3 


1 36.7 




4.7 


4.7 






I. A 




8.7 


1.3.4 




4.0 


3.0 


13 


.30 


.48 




.82 


.90 




2.7 


2.5 




.66 


1.5 




4.9 


4.9 




4.4 


2.9 




3.3 


3.4 


14 


1.5 


2.9 




0.0 


.07 




2.2 


2.3 




.44 


1.1 




1.5 


1.2 




4.4 


4.3 




.48 


.48 



Underlined values indicate a fairly significant change between the 1st half and the 2nd half of the 
semester in the mean values. 
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Figure 5.5(b) shows that all. of the instructors used, Category 2 

statements (Positive reinforcement; affective instructor comments) at one 

. time or another during the semester. Eleven of the instructors increased 

their use of these types of statements between the first and second half 

of the semester while only six decreased their use. This may be a result 

of feeling more comfortable with the class after some time has paJled. 

Instructor #28 increased the use of statements of praise most over the 

semester (from 1.956 to 2.8%). On the other hand, Instructor #17 

.decreased the use of statements of praise most over the semester (from 

3,Z% to 2.5%). The use of praise ranged from a high of 3.3% of the time 

(Instructor #17), or 2.64 minutes/Hh cTals, to a low of 10% (Instructor 

#20), or .05 minutes/MWF class. It would be very interesting to see if 

t 

this pattern (increasing use of praise) is also prevalent in smaller 
university classes. 

The percentage means for Category 3 (Repeating a student response; 
providing corrective feedback; building -orr- a student response) are 
graphed in Figure 5.5(c). The use of statements which fall into this 
category decreases in 12 of the classes while it rises in only seven of 
them. Instructors #13 and #24 dramatically increase their use of 
statements which are coded into Category 3 over the course of the 
semester; from 2.8% to 7.9% for Instructor #13 and from 1.2% to 5.7% for 
Instructor #24. For the most part, these instructors' Category 3 
statements consist of repeating the answers of their students rather than 
building on their answers or providing corrective feedback. 
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Figure 5.5(c). CIAS Category 3 (Repeating a student response; providing corrective 

feedback; building on a student response) mean percentages for 
first and second half of semester. 
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The use of Humor (Category 11) by the instructors is graphed in 
Figure 5.5(d). It is Interesting to note that 10 of the 19 instructors 
decreased their use of humor in the second half of the semester. Perhaps 
the humor is used initially to .make the students feel welcome in the 
large class and its use is then decreased after the instructor feels the 
period of adjustment has passed. Instructor #22 used humor most 
frequently (3.4jli or 2.7 min./TTh class) during tKd first half of the 
semester but its use dropped quite dramatically during the second half of 
the semester (1.6% or 1.3 min./TTh class). On the other hand. Instructor 
#18 used humor least (0.8% or .04 min/MWF class) but was consistent over 
the course of the semester. 

The use of questions (Category 4 - Figure 5.5(e)) increased in 9 of 
the classes, decreased in 8 of the classes, and remained constant in 2 of 
the classes. These changes are divided fairly evenly throughout the 
colleges with one exception: a greater percentage of the instructors in 
Business increased their use of questions during the second half of the 
semester. The instructor whose use of qoe.stions increased the most over 
the semester is #16 (from 4.156 or 3.3 min./TTh class to 7,3% or 5.8 
min./TTh class). The instructor with the greatest decrease in questions 
asked is #25 (from 6.6% or 3.3 min/MWF class to 2.4% or 1.2 min/MWF 
class). 

Since asking questions (Category 4) is usually a prerequisite for 
acquiring student participation (Category 8) a comparison of the graphs 
for these categories provides some interesting information (Figure 
5.5(f)). For example, though Instructor #16 's use of questions increased 
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Figure 5.5(d). CIAS Category 11 (Humor), mean percentages for first and second 

half of semester. 
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Figure 5.5(f). CIAS Category 8 (Cognitive student talk) mean percentages for 

first and second half of semester. 
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from 4.15C to 7.3X,' the cognitive student talk in this class only 
increased from 2.5X to 3.1%. This probably indicates that most of the 
questions which were being asked during the second half of the semester 
were rhetorical in nature. ^On the other hand, though. Instructor #25's 
use of questions decreased from 6.6X - 2.4%, the cognitive student talk 
only decreased from 6.1% - 4.9%. This indicates that a number of the 
questions which were bfeing asked during the second half of the semester 
were higher level questions which required extended student answers. 
This is also.trut in Instructor #28's class (i.e., the same percentage of 
questions are asked throughout the semester but the percentage of student 
response time increas ' *-om 4,3% to 5.7%). Overall, however, the amount 
of student talk which took place in thes^'classes went down in 13 
classes, increased in 5 classes, and remained constant in 1 class. Thus, 
it appears that students get to participate in class less frequently as 
the semester progresses. 

The mean percentages of time spent in Category 13 (Student asked 
questions) are graphed in Figure 5.5(g)r.>re we see that the amount of 
time spent in this category increased in 12 classes, decreased in 5 
classes, and remained constant in 2 classes. The students in classes #17 
and #22 increased the percentage of time they spent asking questions more 
than the students in the other classes. Those in class #14 decreased 
the amount of time they spent asking questiu.i.^ more than the students in 
the. other classes. It is impossible to determine from these data exactly 
why the students in some classes ask more questions during the second 
half of the semester, but it may that the instructors encourage more 
questions after they feel comfortable with the class, or that the 
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Figure 5.5(g). CIAS Category 13 (Student questions) mean percentages for 

first and second half of semester. 
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students feel less inhibited after being in the class awhile. There also 
seems to be some connection between the increases or decreases In 
Categories 4 and 8 and those in Category 13. In classes #15, #17, #16, 
and #24 all three categories show an increase in the mean percentages and 
in classes #18, #14, #23, and #27 all three categories show a decrease. 
We were aware that "Instructor questions" (Category 4) were related to 
"Cognitive student responses" (Category 8), but were not aware that 
"Student questions" (Category 13) would, in many cases, also be related. 

At times when no verbal' activity Is taking place the observer codes 
a Category. 10 (or zero). The mean percentages for this category are 
graphed In Figure 5.5(h). Here we see thaJ there was an Increase In the 
amount of silence observed In 13 of the classes, a decrease In five (5) 
of the classes, and no change In one (1) class. The amount of silence 
observed In class #22 triples between the first and second half of the 
semaster; from 6.1% or 4.9 min/Hh class to 18.1% or 14.5 mln./Hh class. 
The largest decrease in the amount of silence observed takes place In 
class #24; from 14.0% or 7 mIn./MWF clas_s3to 4.7% or 2.4 mIn./MWF class. 
There Is also a substaSStial decrease In the amount of silence observed In 
the class of Instructor #17 (from 13.8% or 11.0 min./TTh class to 4.9% or 
3.92 min./TTh class). Instructor #13' s use of silence remains quite high 
for both halves of the semester; from 13.2% or 10.6 min./TTh class to 
16.3% or 13.0 min./TTh class. For the most part, the amount of silence 
which is observed in the other classes remains relatively constant over 
the semester. Most of the silence which was observed In these classes 
consisted of times when the students were doing an assignment at their 
seats, taking a quiz, or looking at a visual aid. The purposeful use of 
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Figure 5.5(h). CIAS Category 10 (Silence) mea~rr percentages for first and 

second half of semester. 
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silence as "wait time" after Instructor posed questions was not observed 
very frequently. 

Category 14 Is coded when the Instructor is writing on board or 
overhead without talking. The mean percentages for this category for the 
first and last half of the semester are. graphed in Figure 5.5(i). As can 
be seen, all of the instructors in Natural Science, Engineering and 
Liberal Arts use this technique at one time or another. However, there 
are two instructors in Business who did not use this technique. This is 
probably because these instructors used slides as visual ?'d^ to their 
lectures as opposed to overhead transparencies or the blackboard. 
Instructors #15 1n NS and #27 in LA used-tifis technique most frequently; 
5.4% and 5.2% for #15 (or about 2.7 min.) and 4.4% and 4.3% (or about 3.5 
min.) for #27. The findings for this category show that instructors 
seldom just write information on the board or overhead without talking 
about what was written. Because of this fact, many instructors tend to 
"talk to the board" while they write, often making it difficult for the 
students to hear what is being said. "1.-- 

The first and second half mean percentages for Category 5 (Lecture) 
are graphed in Figure 5.5(j). As was noted earlier, this is the category 
which is recorded f^ust frequently in large university lecture classes. 
It is interesti <:o nOwe that the percent of time spent lecturing went 
up\for eight (8) of tb« instructors, went down for nine (9) of the 
instructors and remained constant for two (2) of the instructors. For 
the most part, however, the amount of time spent lecturing remains fairly 
constant over the course of the semester (i.e., the increases and 
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Figure 5 5(i) CIAS Category 14 (Writing on board or overhead without talking) 

mean percentages for first and second half of semester. 
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Figure 5.5(j). CIAS 'Jatego ry 5 (Lecture) meariLpercentages for first and 

second half of semester. 
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decreases are quite small). The largest increase! in time spent lecturing 
is found in the class of Instructor #14 (12.4% increase - or 9.9 min/TTh 
class). The largest decrease is found in the class of Instructor #22 
(14.8% decrease or 11.8 min./TTh class). The amount of straight 
lecturing which is done by the i nstructors_ decreases in 71.4% of the 
classes in Liberal Arts and increases in 60.0% of the classes in Natural 
Science. 

Some interesting observations can be made by comparing the data for 
Category 5 (Figure 5.5(j)) an,d Category 12 (Figure 5.5(k)). First, we 
note that there are the same number of instructors who increase, 
decrease, or remain const^int in their usfrDj^ both categories (+=8, 'i'-9,.-»- 
=2). In 13 of the 19 classes (or 68%) an increase in Category 5 results 
in a decrease in Category 12 and vice versa. Also, the instructors who 
have low mean percentages in one of these categories tend to have higher 
mean percentages in the other category. Thus, if the total mean 
percentages for both categories were combined, we would find that all of 
the observed instructors lectured (with Qr-;v*ithout visuals) approximately 
the same amount of time (80% - 85%). 

The first and second half mean percentages for Category. 6 (Providing 
Oies; giving directions; focusing on main points) are graphed in,/igtjre 
5.5(1). Here we note that there was a decrease in the use of theie types 
of statements in 12 of the classes and an increase in their use in 7 of • 
the classes. This is probably due to the fact that instructors Miid that 
it becomes less necessary to give as many specific directions as the 
course progresses. Most of the changes in the use of statements of this 
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Figure 5.5(k). CIAS Category 12 (Simultaneous lecture with visuals) mean 

percentages for first and second half of setrtester. 
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Figure 5.5(1). CIAS Category 6 (Providing cues; giving directions; focusing 

on main pointsj mean percentages for first and second half 
of semester. 
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type are quite small. The instructor whose use of Category 6 statements 
decreases the most is #11 (from 13.4* to 7.1% or from 6.7 min./MWF class 
to 3.6 min./MWF class). The instructor whose use increases the most is 
#20 (from 7.8% to 11% or from 3.9 min./MWF class to 5.5 min./MWF class). 
The average mean percentage for aVT. of the- instructors on this Category 
is about 9% (4.5 min./MWF class or 7.2 min./TTh class). This is really 
quite high and results in a large number of these statements per class 
when one considers that each cue or focusing statement only takes several 
seconds to say. (There could be as many as 90 such statements made in a 
MWF class or as many as 144 statements made in a TTh class.) This is 
encouraging because statements of this type guide the students in focusing 
on the main ideas of the lecture and also act as an organizing mechanism 
in their notetaking. 

Figure 5.5(m) shows the mean percentages for the first and second 
half of the semester for Category 7 (Criticism). As can be seen, only 4 
of the instructors used statements of criticism throughout the semester. 
Instructors #18, #19, #21, and #23 only Qjifcl such statements at the 
beginning of the semester; probably to establish control in these large 
classes. (The size of these classes were 300, 300, 200 and 120 
respectively.) Instructors #15 and #20, on the other hand, only used 
statements of criticism toward the end of the semester. (Their classes 
had 130 and 300 students respectively.) As can be seen. Instructor #13 
used statements of criticism most frequently (.49%), during the second 
half of the semester. This averages out to approximately .4 minute/TTh 
class (or -^24 seconds). Thus, though it looks like a great deal of 
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Figure 5.5(m). CIAS Category 7 (Criticism) mean percentages for first and 

second hal f of semester. 
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Figure 5.5(n). CIAS Category 9 (Non-cognitive student talk) mean percentages 

for first and second half of semester. 
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criticism on the graph, It Is really very little In terms of the time 
spent making these statements. 

/ 

The final graph in Figure 5.5 Is graph (n) for the first and second 
half mean percentages for Category 9 (nonccognltive student talk). As 

can be seen, most of the non-cognitive student talk occurred during the 

/ 

last half of the semester. The mean percentages for th^s category 
increased in 6 of the classes, decreased in 2 classes^ and remained 
constant in 11 of the classes. In comparing Figure S(.5(m) and 5.5(n) we 
find that there is a relationship between the Increasing non-cognitive 
student talk and the increased use of criticism (e.g.. Classes #15, #13, 
#17, #22, and #20). Again, however, thoiTgtf there appears to be a great 
deal of non-cognitive student talk in the class of Instructor #17, it 
only encompasses .455C of the time (or .4 min./TTh class). For the most 
part, there is much less non-cognitive student talk in these large 
classes than one might expect. 

By course level . The courses which- were observed directly by an 
observer were categorized as to the relative level- lower-division 
(containing primarily freshmen and sophomores) and upper-division 
(containing primarily juniors and seniors). (There were eight (8) 
lower-division and eleven (11) upper-division courses which were observed 
in this study.) The CIAS mean frequencies for each category were then 
calculated for each group and a one-way ANOVA was run on the data. The 
results are given in Table 5.30. 
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TA'bLE 5.30 

One-wa: WVA b'f Mean Frequency of Use for Each 
CIAS Category by Course Level 



Category 


Lower-Division 


UDPer-Dty.islon 


Fvalue 




1 


.8355 


.6867 


.494 


.48 




.8673 


1.1444 


3.699 


.0559 


*3 


2.6309 


1.6356 


4.255 


.04 


*4 


3.5100 


2.6467 


6.315 


.01 


*5 


48.1845 


57.9789 


. 13.286 


.0003 


*6 


9.5527 


8.1967 


5.904 


.02 


7 


.0527 


.0278 


.8979 


.34 


8 


2.8536 


3.0289 


.152 


.70 


9 


.0227 


.0367 


.476 


.49 


10 


4.8611 


5.2289 


.076 


.78 


n 


.8627 


.9400 


* .356 


.55 




22.1845 


14.9478 


8.833 


.003 


13 


1.8345 


2.3411 


2.747 


.10 


*14 


1.6382 


"•.9456 


5.9739 


.02 



*Signif leant difference at p ^ .05 
AApproaching significance. 
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As can be seen in this table, there are significant differences at 
the .05 level between tht class levels in the instructor's use of 
certain types of statements. For example: 

•** 

* 1. Lower-division instructors repeat student answers and 

provide corrective feedback (Category 3) significantly more 
(p » .04) than do Upper-division instructors. 

2. Lower-division instructors ask significantly more (p = .01) 
questions (Category 4) than do Upper-division instructors. 

3. Upper-division instructors lecture (Category 5.) 
significantly more (p = .0003) than do Lower-division 
instructors. 

4. Lower-division instructors provide significantly more (p « 
.02) cues (Category 6) than" iiij. Upper-division instructors. 

5. Lower-di' , .-n iritructors use signif ica^'ily more (p„ = 

003) visu^als (Category 1^ along with their lectures. 

6. Lowerrdivision ins. i- ctors write on the board or overhead 
without talking (Category 14) significantly more (p = .02) 
than do Upper-division instructors. 

The results for Category 2 are approaching significance (p - .0559) 
and indicate that Upper-division instructors use positive reinforcement 
more than do Lower-division instructors. This is somewhat surprising 

« 

given that the other categories which show a significant difference (in 
which the Lower-division instructors use them more frequently) indicate 
that Lower-tii vision instructors seem to be awar^' of their students' 
inexperience and thus use more questions, repeat students answers more 
frequently, provide more cues, and utilize more visual aids along with 
their lectures. Pei^haps Lower-division instructors use less positive 
rein^o'rcenjent because their students respond somewhat less or they feel 




it Is not worthwhile to reinforce student answers which are at the lower 
cognitive levels (which ri|ost are). 

The only category of statements which is used significantly more by 
Upper-division instructors is Category 5,<Lecture). This probably would 
be expected because Upper-divisipn instructors assume that their students 
have mastered the art of inotetaking and assimilation of information. 

Summary; Direct Observation Data . This aspect of the study 
provided a great deal of specific information concerning the verbal 
interactions which occur in large classes. We found that the bulk of the 
class time (about 70%) was spent lecturiiig -llwith or w.thout the aid of 
visuals) and that, on the average, the instructors talked approximately 
85% - 90% of the time during each class period. (This equals about 43 - 
45 minutes/MWF class period or about 68 - 72 minutes/TTh class period.) 
On the average, student participation included about 5% of the time 
during each class periou (about 2.5 minutes/MWF class period or 4 
minutes/TTh class period). 

Figure 5.6 shows the CIAS means for each college (these are also 
recorded in Table 5.26). As is indicated here, most of the instructors 
spend about the sanie amount of time in Categories 1 (Accepting student 
feelii.jS), 2 (Positive reinforcement), 4 (Questioning), 6 (Providing cues 
and directions), / (Criticism), 9 (Non-cognitive student talk), 11 
(Humor) and 13 (Student questions). There is some variation in Category 
3 (Repeating student response, providing corrective feedback), with the 
Engineering instructor^ shown as using statements which are coded into 
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Figure 5.6. CIAS Category means for each College. 
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this category most frequently. Category 5 (Lecture) shows quite a bit of 
variation with Business and Liberal Arts instructors lecturing most. 
There is a little variation on Category 8 (Cognitive student talk), with 
the students in Liberal Arts classes participating more frequently than 
the others. Category 10 (Silence) is the-- next one which shows a 
difference among the colleges. Here we see that silence occurs more 
frequently in the College of Engineering classes. There is quite a bit 
of variation among the colleges in the amount of time spent in Category 
12 (Lecture with visuals), with the instructors in Natural Science using 
this technique most frequently. Finally, there seems to be a real 
distinction between the technical vs. non-technical instructors in their 
use of Category 14 (Writing on board without talking); i.e., the Natural 
Science and Engineering instructors use this technique more than do those 
in Business or Liberal Arts. Overall, however, there is a great deal of 
similarity in the verbal interactions which occur in each of the four 
colleges in which classes were observed. 

Sever-al trends can be noted when a cpraparison of the mean percentage 
of use of each category for each instructor during the first half of the 
semester is compared with the use during the second half of the semester. 

1, Category 1 (Accepting student attitudes) - Most instructors 
increased their use of this type of '..tateinent. 

2, Category 2 (Positive reinforcement) - Most instructors 
increased their use of this type of .tenient. 



3. C ategory 3 (Repeating a student response, providing 

corrective feec^back) - Mos.. instructors decreased their use 
of this type of s*:atem9nt. 
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4. C&teqory 11 (Humor) - Most of the Instructors decreased 
their use of this type of statement. 



5. Category 4 (Questions) - About an equal number of 

Instructors increased and decreased their use of questions. 



6. Category 8 (Cognitive student response) - The amount of 
student response participation decreased in most of the 
classes during the second half of the semester. 



7. Category 13 (Student asked questions) - The amount of time 
spent In student asked questions increased in most of the 
classes. 



8. " tegory 10 (Silence) - Most of the instructors increased 
wiiri amount of time spent in silence. 

9. Category 14 (Writing on board or overhead without talking) 
- About an equal number of instructors increased and' 
decreased their use of this technique. Two of the 
instructors never used it. 



10. Category 5 (Lecture) - The amount of time spent lecturing 
remains nearly constant for most of the instructors. 



11. Category 12 (Simultaneous use of visual and verbal 

presentation) - The amount .of time spent lectu?' ing with 
visuals remains nearly cdni-tant for most of the 
instructors. 



12. Category 6 (Providing cues, giving directions) - Most of 
the instructors decreased their use of this type 
statement. 



13. Category 7 (Criticism) - Of the nine (9) Instructors whc 
used these types of statements, five (5) increased their 
use and four (4) decreased their use. 



14. Category 9 (Non-cognitive student talk) - Of the eight (8) 
classes in which this category was recorded, six (6) 
showed an increase while two (2) showed a decrease. 



V When comparing the verbal interactions in Lower-division vs. 
Upper-division courses, it was found that Lower-division Instructors seem 
to be more student -oriented in that thpy use the following types of 
statements significantly more than do Upper-division instructors: 

Category 3 (Repeating student response; providing corrective 
feedback; building on a student response) 

Category 4 (Asking questions) 

Category 6 (Providing cues; focusing on main points; giving 
directions; assignments, process) 

i 

Category 12 (Simultaneous visual and verbal presentation) 
Category 14 (Writing on board without talking) 

Cognitive Levels of Instructors' Evaluative Instruments 

Each instructor who participated in LCAP was asked to • -.vide r 
sample of his/her quizzes, exams, homewo'r_k. assignments, e-d written 
assignments (e.g., term paper assignments) to be analyzed. Each 
evluative instrument was first examined according to Bloom's Taxonomy of 
the Cognitive Domain to see what percentage of each cognitive level was 
being required Oi the students. For example, a two-item exam In which 
Item 1 requires analysis level thinking and Item 2 requires synthesis 
level thinking would be analyzed as being composed of 50% analysis fid 
50% synthesis. If an instructor supplied more than one quiz, exe.n» 
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homework asilgnmeiit, or written assignment, an overall average of the 
percentages for each cognitive level was computed for that particular 
type of instrument. 

Before presenting the results, a warning about the reliability of 
classifying each item of an evaluation instrument is needed. In most 
cases, items were easily classified into one of Bloom's six cognitive 
levels. In other cases, some items were very difficult to classify 
because they appeared to fall between two adjacent levels. In this 
situation, the ambiguous items were classified into the lower level. 
Thus, the results are a rather conservative estimate. 

Below are several sample questions fr-im each of the cognitive levels 
of Bloom's Taxonomy. These are provided to give the reader a better idea 
of the type of thinking which was required for each level. (For 
additional examples please see Bloom. 1972.) 

1. Knowledge = -- 

a. From the following list, remembering your typeface 
handout, select the most casu" . (informal) typeface. 

a. Americana d. Helvetica 

b. Me 11 or e. Cooper 

c. Goudy 

b. According to Fasteau, the end result of male 
social iz3t ion to sex stereotypes is competence in 
interpersonal relationships, 

a. True b. False 
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2. Comprehension 



a. Among the following ions, the one least 11 ely to form 
coordination comp 'unds is 

(1) Fe*2 (3) Vigil Mn'^ 

(2) Rb* (4) Zn^ 

,\ • 

b. Assuming a drawdown pressure of 100 psi, determine the 
downhole rate of production for a well in the field. 

3. Application 

a. On the surface of the Earth two different objects have 
two different weights. Compare their masses. Explain 
fully. 

b. How many grams of SrCl« are in 200 ml of 0.30 M 
solution? 

(1) 7.4 (3) 13.1- -(5) 9510 

(2) 9.5 (4) 31.7 



4. Analysis 

a. Compare and contrast the plight of free blacks and 
slaves in the South during the years 1800-1860. Make 
sure that you thoroughly discuss their social, economic, 
and legal conditions. 

b. In what ways is Texas politics in particular like 
American politics in general? In what ways is the 
politic of Texas unlike politics in the country as a 
whole? Consider: patterns of participation, 
legislature, executive, administration. 



5. Synthesis 

a. What is "knowable" is negotiated. Such terms as 

control led ."oily , nonordinary m odes of knowi ng, the pit 
and midwoTld have been used to dasci -he negotiation. 
Discuss the terms (controlled folly, etc.) and texts and 
the degree to which you have revised your .lotion of 
"knowability". 
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b. Think of a plot based upon an obstacle that could occur 
between the following two sentences, and then develop a 
short story using these sentences and your plot. 

It was an event to be honored with a party, preferably 
a surprise party... "It was a surprise, all right— a 
surprise all the way around!" 



6. Evaluation 

a. Analyze the statement below. Feel free to agree or 
disagree^with the statement, but cite specific examples 
from the course material to support your argument. 
Address the statement from any angle you choose (i.e., 
work, law, sexuality, family, stereotypes, feminist and 
ant i -feminist ideology, etc.). 

"I'm for equal pay for equal work, but I think women 
should be treated like ladies, put up on the pedestal. 
After all, women are the wives and mothers of our 
society." - 

b. Describe the major beliefs and values of Classical 
Liberalism. Describe the major beliefs and values of 
Democratic Theory. Do you think that these two systems 
of thought -are successfully integrated, in theory and 
practice, in\the United States? Why or wh not? 



By college . The widest range of cognitive levels was found in the 
College of Liberal Arts - which covered \1T levels (see Figure 5.7). The 
lowest range of cognitive levels was found in the Colleges of Business 
and Engineering, which covered from knowledge/comprehension to 
application. Since the College of Engineering is represented by only two 
instructors, both of whom taught introductory courses, this range of 
cognitive levels is expected. Business, however, is represented by five 
instructors, all of whom teach upper division courses. Having 16 
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Figure 5.7 

Cognitive levels of instructor's evaluative instruments^ by college 
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business exams which have application as the highest cognitive level is 
unexpected. 

/ 

By instructor . The percentage of each cognitiv|B level on each exam, 
written work, quizzes, and homework, by instructor is graphed in Figures 
5.8(a) - 5.21(a). The overall percentages for all exams by instructor 
are graphed in Figures 5.8(b) - 5.21(b). The instructors have been 
grouped by college to. provide a more convenient means for comparison. 

In the College of Natural Scinces there were five instructors who 
participated in LCAP. Instructor #11 gave three quizzes, a final exam 
and a written project. As can be seen tn Figure 5.8(a) most of the 
questions on all of the exams were at the knowledge level; all of these 
questions were multiple-choice type questions. The written paper 
required a little more advanced cognitive thought (comprehension). 
Overall, the exams in this class consisted of 825^ of the questions at the 
knowledge level and 18% of the questions at the comprehension level (see 
Figure 5.8(b) ) . 

Instructor #12 gave two exams and a make-up exam. The cognitive 
levels for these, exams are graphed in : igure 5.9(a). Though this was a 
lower-division course, these exams tested the students up to the analysis 
level and consisted of short-answer type questions. It is interesting to 
note that the greatest percentage of analysis level questions occurred on 
the make-up exam. The first exam also contained a good amount (50%) of 
analysis-level questions. However, the f.ir\al exam concentrated primarily 
on comprehension-level questions. Looking at the overall percentages 
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Figure 5.8 (a & b) ' 
(a) - Percentage of cognitive levels required on exams for Instructor 11 
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(b) - Average percentage of cognitive levels required across three quizzes 
and the final exam for Instructor 11 

kn - knowledge 
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across the three exams given in this class (see Figure 5.9(b)) we find 
28% of the questions at the comprehension level, 27.7% at the application 
level, and 44.3% at the analysis level. 

■» 

Instructor #15 gave the students three major exams and a final exam. 
All of the questions on these exams consisted of problems to be worked. 
According to our analysis of the questions on these exams they were ajj. 
at the application level. 

1 

Instructor #18 did not supply copies of the exams given in this ^ 
course for item security reasons. However, in the interview with this I 
instructor it was indicated that the questions asked on exams were at xhe 
application and analysis levels. 

The final instructor in Natural Science was Instructor #19. For 
this class a number of homework assignments were given in addition to 
three major exams and a final exam. The cognitive levels for the 
homework assignments are graphed in Figure-5.10(a^). The questions on 
these homework assignments consisted of short answer and 
f ill-in-the-blank type questions. As can be seen, the homework began 
with questions which were primarily at the comprehension le\^l and ended 
up with most of the questions being at the application level. The 
cognitive levels for the exams are graphed in Figure 5.10(a2). The 
questions at the knowledge and comprehension levels predominate, with 
those at the application level increasing somewhat on the final exam. 
(All of the exam questions were in a multiple-choice format.) Because 
this was a lower division class, this range of cognitive levels is 
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Figure 5.9 (a(& b) 
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Percentage of cognitive levels required on homework for Irtstructor 19 
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expected. In Figure 5.10(bj^) we find an averge of 67.4% of the homework 

« 

questions were at the comprehension level while 33.6% were at the 
application level. Figure S.lOCbg) shows that on the exams 40% of the 
questions were at the knowledge level, were at the comprehension 
level, and 6.3% were at the application level. 

The evaluation instruments of instructors in the College of 
Engineering are analyzed next. Instructor #13 used written assignments 
and exams to evaluate the students' learning in this course. As can be 
seen in Figure 5. 11 (a,) all of the written assignments required the 
students to think at the comprehension level. These papers ranged from 
one of 25-50 words in length to one of 400-700 words in length. The 
cognitive levels for the exams in this course are graphed in Figure 
5.11(a2). The questions for these exams were either fil 1-in-the-bla.nk or 
short answer. It is interesting to note that knowledge level questions 
were not present on the first exam, increased to 80%+ on the second exam, 
and fell to '^55% on the final exam. Oust judging by the cognitive levels 
required on each exam, the first exam was..most difficult and. the seconi 
exam was least difficult with the final exam being of iroderate 
difficulty. Figure 5.11(b) shows the average percentage for each 
cognitive level across the three exams: 46.3% at the knowledge level, 
34.7% at the comprehension level, and 19% at the application level. 

• The other Engineering instructor is #29. This instructor used 
frequent quizzes plus a mid-term and final exams. The cognitive levels 
for each of the eight quizzes given in this class are graphed in Figure 
5.12(a, ). As can be seen, the first quiz required the students to thinK 
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Figure 5,11 Ca^, ag, & b) 
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at only the knowledge and comprehension levels (50% of each). The second 
and succeeding quizzes required varying amounts of comprehension ard 
application level thinking. Quizzes 3, 5 and 7 requir'-^ only application 
level thought processes while. quizzes 4, 6 and 8 required about 50% each 
of the comprehension and application levels. The questions on these 
quizzes were primarily short answer with some f ill-in-the-blank and 
multip'j-choice on quizzes #1 and #3. The cognitive levels for the exams 
given in this course are graphed in Figure S.lZlag). In all three of the 
exams the students are required to respond most frequently at the 
comprehension level. Though there are application level questions on the 
exams, there are relatively few. The questions on the two exams were all 
multiple-choice type. The average percentages of the cognitive levels 
required in the quizzes are graphed in. Figure 5.12(bj^). Here we see that 
6.25% of the questions were at the knowledge level, 37.1% were at the 
comprehension level, and 56.7% were at the application level. The 
average percentages of the cognitive levels required in the exams are 
graphed in Figure 5.12(b2): 21.5% at knowledge level, 75% at 
comprehension level, and 3.5% at application level. 

In the College of Business there were five instructors who 
participated in LCAP. Instructor #14 used seven homework assignments to 
evaluate the Students- in this- class. As can be seen in Figure 5.13(a) 
these assignments tested the students up to the application level and can 
be classified as consisting of f ill-in-the-blank and short answer 
questions. Assignments #1 and #3 tested only the comprehension level, 
assignments #2, # 4 and #7 tested only the application level, assignment 
#5 tested the knowledge, comprehension and application levels, and 
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Figure 5.12 (a^f bj^, & bg) 
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assignment #6 tested the comprehension and application levels. Figu-'e 
5.13(b) shows that the evaluation instruments in this class focused 
primarily on the application level (50.4%) with the comprehension level 
comprising 46.7% of the questions and questions at the knowledge level 
only making up 2.9% of the total. >• 

The cognitive levels of the four exams given by Instructor #17 are 
graphed in Figure 5.14(a). These exams concentrated on questions at the 
knowledge and comprehension levels and consisted entirely of 
multiple-choice questions. Figure 5.14(b) shows that, overall, 67% of 
the questions on the exams were at the knowledge level and 33% were at 
the comprehension level. 

Instructor #21 gave three exams and a final during the semaster. In 
Figure 5.15(a) we see that all of the questions on .these exams were 
either at the comprehension or application levels and" consisted of 
true/false and multiple choice types of questions. It is interesting 
that the exams are more heavily weighted .toward application-level 
questions until the final which is weighted toward comprehension-level 
questions. This indicates, to some extent, that the final may have been 
somewhat less difficult than the other three exams. Overall, 50.4% of 
the questions on this Instructor's evaluation instruments were at the 
application level (Figure 5.15(b)) and 49.6% were at the comprehension 
level. 

Instructor #22 used three quizzes, three major exams and a final 
exam to evaluate the students' progress in the course. The three 
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Figure 5.13 (a & b) 
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Figure 5.15 (a & b) 
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quizzes, graphed In Figure 5.16(a^). consisted of true/false questions 
which tested the students primarily at the knowledge level. While the 
three major exams and final exam included questions at the 'application 
level. Figure 5.16(a2) shows that a very small percentage of the 
questions were at this level. All of the exams were comprised totally of 
multiple-choice type questions. Figure 5.16(b^) shows that 83% of the 
questions on the three quizzes were at the knowledge level and 17% were 
at the comprehension level. Figure BASib^) indicates that, across the 
four exams, 45% of the questions were at. the knowledge level, 45.5% were 
at the comprehension level, and 7.5% were at the application level. . 

We were provided with a copy of one homework set (#4) and the final 
exam for the class of Instructor #26. All of the twelve questions on the 
homework set were at the application level and consisted of 
fill-'i'^-thB-blank and short-answer types of questions. (See Figure 
5.17(a)). The final exam was comprised of 60 multiple choice questions: 
70% at the knowledge level, 17% at the comprehension level and 13% at the 
application level (Figure 5.17(b)). 

The cognitive levels required in the evaluation instruments of the 
instructors in the College of Liberal Arts will be discussed next. As 
can be seen in Figure 5.18(a) Instructor #16 used frequent short quizzes 
and three major exams to evaluate the st.idents' progress. The third quiz 
contained a very high percentage of questions at the application level 
but, overall, the primary emphasis seems to be on questions which require 
thinking only at the knowledge and cjmprehension levels. The questions 
on quizzes #1, #2, and #4 were short-answer, those on quiz #3 were a 
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Figure 5.16 (a^^, b^, & bg) 
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Figure 5.17 (a & b) 
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mixture of short-answer and multiple-choicfi, ?.nd those on quiz #6 were 
all multiple-choice. The average percentages of each cognitive level 
tested on the quizzes are graphed in Figure 5.18(b^)-- 35% knowledge, 40% 
comprehension, 25% application - and the levels tested on the exams are 
graphed in Figure 5.18(6^) - 47% icnowledg^,.'51% comprehension, 2% 
application. The questions on all of the exams' were in the 
multiple-choice format. 

Instructor #20 tested the students via essay exams and required them 
to respond at the upper three cognitive levels (analysis, synthesis, 
evaluation). Because there were 300 students in this class and it was z 
lower-division introductory course this inadiB of testing is not whac one 
would expect. Figure 5.19(a) shows the percentage of each of the three 
exams which were at each cognitive level. Here we see that analysis 
level questions predominated, but evaluation level questions comprised 
25%-30% of the last two exams and synthesis level questions occurred on 
25% of the Final Exam. The average percentages for each cognitive 't-v-sl 
tested are graphed in Figure 5.19(b) - -73;.3% analysis, 8.3% synthesis, 
18.3% evaluation. 

For Instructor #23 we were only provided with one homework 
assignment. On this assignment the students were asked to respond to 
nine questions, 44% of which were at the comprehension level and 56% of 
which were at the application level. 

A fairly unusual combination of cognitive levels was required on 
Instructor #24 's evaluation instruments; the two lowest levels and the 
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Figure 5.19 (a'& b) 
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two highest levels. As is indicated in Figure 5.20(a) the mid-term exam 
included questions at the knowledge and comprehension levels and the 
final exam included questions at the knowledge, comprehension and 
evaluation levels. Both of these exams were comprised of true/false 
multiple-choice and essay questions. The*- Written Final Project required 
the students to perform at the synthesis level and the Extra Credit Essay 
was at the evaluation level. The average percentage of each cognitive 
level required on the two exams are graphed in Figure 5.20(b) - 71% 
knowledge, 19% comprehension, 10% evaluation. 

I 

/ 

The evaluation instruments for Instructor #25 consisted of a Written 
Report and a Final Exam. For the written-report the students were able 
to choose between two essay questions— one (the easy one) which required 
the students to respond at the comprehension level and the other (the 
hard question) which required thetn to respond at the evaluation level. 
On the Final Exam the students were given two essay questions from which 
they were to choose one to answer. Both of these questions required the 
students to respond at the analysis levels ■ (The observer who sat in on 
this course commented, "This is not an easy course!") Also, as noted 
earlier in this report, this was the only" lower-division required course 
which was rated in the top five in the enjoyment ratings (refer to Table 
5.8, p. 48). 

The cognitive levels required in the evaluation instrument of 
Instructor #'.7 are graphed in Figure 5.21(a). Here, as in many other 
large classes, questions at the ''nowledge and comprehension levels 
precfoniTimte* — AU_Qf__the^xams in this class were comprised of 
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Figure 5.20 (a & b) 
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multiple-choice questions. Figure 5.21(b) shows that 7^% of the 
questions across the three exams were at the knowledge level, 24.7% were 
at the comprehension level and only 1.3% were at the application level. 

The last instructor in the College of Liberal Arts whose evaluation 
instruments were analyzed was Instructor #28. This instructor was ranked 
#1 in the enjoyment" ratings despite the fact that he only gave two exams 
(consisting of one question each), one at the synthesis leveT (the 
mid-term) and one at the analysis level (the final). The students did 
not have several questions from which' to choose, they all had to answeV' 
the same questions. . - 

c 

Range of cognitive level across enjoyment rankings of Instructors . 
On the Student Attitude Survey which was discussed earlier, the students 
were asked "How did you enjoy attending this class?" The students then 
rated how well they liked the course on a scale of 1 (yes, very much) to 
5 (no, nqt at all). Averages of these ratings were computed for each 
instructor and a ranking of the most enjoyed course down to the least 
enjoyed course was formed. When the range of cognitive levels was 
determined. for each professor based on his/her quizzes, exams, homework 
assignments, and term papers it was found that instructors whose 
evaluation instruments required that the students use analysis-,, 
synthesis-, and/or evaluation-level thinking processes were rated in the 
top half of the enjoyment rankings (see Table 5.31). The rankings for 
the five instructors whose evaluation instruments went beyond application 
were ranked 1, 2, 3, 5, and 7, respectively. The implication is that 
students who are challenged to use analytical, synthesis, or evaluative 
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Figure S.21 (a & b) 
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- Average percentages of cognitive levels required across three exams for 
Instructor 27 

kn - knowledge 
CO - comprehension 
ap - application 
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TABLE 5.31 

Cognitive Levels Tested by Instructor/Enjoyment Rating 
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Mean 
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B 
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16 


5 
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J.1 
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A 


X 






7. 


2.2281 


L 


R 


300 


10 


30 


31 


21 




2.17 


20 








X 


8. 


2.3826 


L 


R 


140 


10 


30 


28 


29 




\ 2.01 


13 


X 


X 


X 




9. 


2.5739 


U 


R 
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18 


21 


30 


27 


1 


2-48 
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X 




10. 
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N 
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13 


54 


26 


3 
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31 
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9 


36 


31 


15 


3 


2.37 
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X 
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2.39 
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X 
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3.3016 
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R 
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6 


12 


22 


44 
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1.47 
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X 


X 
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R 
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10 


12 


33 
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X 


X 
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13 


19 
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18 
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X 
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300 
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*Type Class 
U = Upper division - Jr/Sr 
L = Lower division - Fr/Soph 



**Cognitive Levels 

K - Knowledge An 

C - Comprehension S 

Ap - Application E 



Analysis 

Synthesis 

Evaluation 
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thinking enjoy the course more. Further research into the relationship 
between students' attitudes toward a course and the cognitive level 
required by the exams, etc., would be worthwhile. 

..% 

Support Assistance Needs Survey Data 

During the Spring semester. 1981 a survey was sent to 126 faculty 
members who were teaching large classes or had taught large classes 
during the previous semester in the four target colleges. The purpose of 
this survey (see sample in Appendix E} was to acquire information from 
the UT faculty concerning the adequacy of the support assistance which is 
provided to them. Sixty-nine completed survey forms were returned, a 
response rate of 55%.. The" results obtained from this survey are shown in 
Table 5.32. 

The survey form was divided into three sections: (1) a section 
which dealt with TA/clerical assistance,. (2.) a section which asked 
about the media assistance, and (3) a section concerning the 
teaching/learning environment in specific classrooms on the UT campus. 

« 

Under TA/clerical assistance needs, the overall feeling seemed to be 
that more help was needed; especially for grading, leading 
help/discussion sessions and the development of AV aids. The average 
amount of au'ditional TA time which is needed is approximately 15 
hrs./week. 
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TABm 5.32" 
Support Assistance Needs Survey Results 





Survey C/uestion 


NS 


B 


E 


1 A 

LA 


Overall 




# responses 


29 


24 


7 


66 


69 


1 . 


Average class size 


, 190 


180 


190 


210 


190 


2. 


Average #TA hrs/cl ass/week 


23 


17 


25 


18 


20 


3. 


Other forms of assistance? 

* 


y=8 
n=8 


y=10 
n=5 


y=4 
n=l 


y=6 
n=25 


y=28 

^ oo 

n=39 


4. 


Could use more help? 


y=7 
n=8 


yll 
n=2 


y=i 

n=4 


y=18 
n=9 


y**37 
n=23 


5. 


Current TA's responsibilities 














Teach Labs 


5 


0 


2 


1 


8 




• *Grading 


9 


9.. 


1 


28 


47 




*Office hrs. 


7 


7 


0 


£0 


34 




*Help/discuss Ion 
sessions 


8 


4 


0 


8 


20 




Record keeping 


1 


7 


1 


4 


13 




AV assi'itancp. 


1 


4 


0 


5 


^ 10 




Test preparation • 


1 


6 


0 


12 


19 




Proctoriiig 


2 


4 


1 


0 


7 




Teachi "^a 


1 

1 


0 


0 


0 


1 






0 


2 


0 


6 


8 




Hnw manv additional hrs/week of 
TA/grader/clerical assistance 
could be used? 


10 


20 


10 


10-20 


'V'15 


7. 


What additional duties would TA 
oerf orm? 
















4 


3 




9 


16 




*Help/discussion 
sessions 


2 


4 




11 


17 




*AV assistance 


2 


3 




5 


10 




Office hours 




3 




4 


7 




P roc to ring 




1 




3 


4 




Library research 


1 


1 




1 


3 




Course development 


1 






1 


2 




Teaching 




1 






1 
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TABLE 5.32 (continued) 



Survey Question 



NS 



Record keeping 

Test preparation 

Divide work more 
evenly among TAs 

8. Media assistance currently 
using in classes: 



LA 



Overall 



1 
3 



9. 



Media assistance would like 
to use but currently don' t 
or cannot: 

Chalk and blackboard 
*16nin films 
*Slides 

LP albums 

Handouts 

Overhead projector 
*Videotape 
Audiotape 
*Other 
i .e., 

a. Wall maps 

b. Computer- terminal 

projection device 

c. Audience response 

system 



4 
2 
2 



2 
1 
2 



5 
3 



4 
5 
3 
2 
3 

10 
2 
1 



10 
6 



*Chalk and blackboard 


15 


12 


4 


29 


60 


*16mm films 


8 


5 


2 


16 


31 


*Slides 


9 


9 


2 


9 


29 


LP albums 


2 


1 




' 3 


6 


*Handouts 


12 


12 


5 


22 


51 


*Overhead projector 


9 - - 


8 


5 


15 


37 


Videotapes 




8 




1 


9 


Audiotapes 


2 


5 


1 


5 


13 


Other 


1 






5 


6 



0 
5 
5 
3 
2 
3 

16 
5 
7 
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TABLE 5.32 (continued) 



Survey Question 


NS 


B 


E 


LA 


Overall 


10. Major obstlde to obtaininQ 
use of the above media 
assistance. 


> 










*Not enough funds 


2 


4 




11 


17 


*Roonis don't have 
facilities 


2 


2 


1 


3 


8 


Not enough time to 
make 










3 


Equipment failures 




2 






2 



♦Highest number of responses to that item. 
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Under Media Assistance needs the respondents said they currently use 
(in order of # respondents indicating use): (1) chalk and blackboard, 
(2) handouts, (3) overhead projector, (4) ISm films, and (5) slides. 
Though many of the respondents were happy^ using what they .vere currently 
using, a number indicated that there were some forms of media assistance 
they would like to use, but could not presently do so. These forms of 
media assistance (in order of their preference) are: (1) videotapes, (2) 
other (i.e., wall maps, computer-terminal projection device, audience 
response systems), (3) 16mm films, (4) slides, and (5) audiotape. The • 
primary obstacle to obtaining the needed types of AV assistance is that 
not enough departmental funds are appropriated for this type of 
expenditure. The secondary obstacle is that many of the large classrooms 
are not equipped with the AV-oriented instructor in mind. 

The instructors who responded to this survey were also asked to 
comment on the teaching/ learning environment provided by the particular 
rooms they have ui^ed for teaching large classes. Their comments were 
combined with those received in the interview portion of the study and 
are summarized in Appendix 6. 

Finally, the respondents were asked to provide any additional 
comments about the adequacy of the support assistance available at 
UT-Austin. The following statements provide a summary of these comments: 
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Natural Science 

1. Most faculty members who responded feel that there is 
relatively adequate support for lower-divicion courses, but 
not for upper-division nurses. 

2. Upper -divis,i on courses should be smaller (50 student 
maximum). .* <• 

3. The large lecture halls are poorly designed and there are 
not enough of them. 

4. The CTE staff should supervise the design of aJJ. new 
classrooms and future renovation projects. 

5. Large class instructors need paid time (2-4 weeks) to 
develop and improve courses. 

Business . 

1. . Need more TAs. 

2. Need better and more multi -media facilities. 

3. Need more money to develop AV aids. 

4. There needs to be more emphasis on the quality of teaching. 
Engineering 

1. The equipment in multi -media rooms and general purpose 
classrooms should be checked daily and serviced immediately 
if needed. 

2. Faculty members need more time for teaching preparation. 

Liberal Arts 

1. Need more TAs. 

2. Need funds for handouts and media aids (especially films). 

3. Need more media-equipped facilities in which to teach large 
classes. 
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4.< Need a centralized AV department which provides services to 
all wi^th little or no charge. 

e 

» 

Instructor Interview Data 

Each instructor who participated in the Direct Observation portion 
of the LCAP study was interviewed by an LCAP- staff member . In addition,' 
24 other instructors who were teaching large classes or who had recently 
taught a large class volunteered their time to be interviewed. The 
interviews lasted approximately 45 minutes and were audio-taped. A list 
of specific questions was used to guide the interviews (see Appendix D). 

Similar interviews were conducted by Stephen C. Brock in 1976 at ^ 
Kansas State University. In these interviews the instructors identified 
four main problem areas in teaching large introductory college courses: 
student anonymity, student heterogeneity, utilizing teaching assistants, 
and testing and grading. These instructors' approaches to dealing with 
the above problesms are presented in Brock*s paper "Practitioners' Views 
on Teaching the Large Introductory College Course." The advice given by 
these instructors is very similar to that given by the UT faculty who 
were interviewed for this study. Thus, the problems identified and 
approaches to dealing with these problems here at UT can be utilized by 

♦ 

instructors at other institutions in which large classes are taught. 

• * 

In the UT interviews the instructor comments have been broken down 
into the following categories: 
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1. Comments concerning interactions with students 

a. Methods to help students learn 

b. Instructional assistance 

c. Getting feedback from students 

d. Encourging student participation 

e. Motivating students 

f. Homework 

g. Keeping the noise level "clown 

2. Ways to personalize instruction 

3. Level of main goals for large classes 

4. Instructor comments about exams 

a. Problems in giving exams to large classes. 

b. Evaluation procedure 

c. Returning exams and homework (logistics) 

d. Grading exams in large classes 

e. Ways to deter cheating 

f. What to do when students challenge exam grades 

5. Some differences between large and srBall classes 

6. The ideal class size 

7. Characteristics of a good instructor 

8. Suggestions to the novice large ,class instructor 

a. Techniques 

b. Organization 
« c. ■ Discipline 

d. Miscellaneous 

■ 9. The teaching/ learning envirormi'ent at UT-Austin 
10. MiscelTaneous comments 
U. Recommendations to the administration 



Comments copcerninq interactions with students . 



To begin with, the primary conpern of the faculty members who were 
interviewed was the lack of personal interaction with the students in 
large classes. Because there is very little contact between the student 
and Instructor, the instructors try using many methods to assist the 
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student In the learning process. For achieving student learning, they 
were unanimous in their feelings that organization, on the instructors' 
part, is essential. This organization is evidenced in clear, written 
handouts and objectives, repetition of main points, and the skillful use 
of multi-media to enhance lectures. Second, the instructors felt that 
instructor enthusiasm is essential to encourage the students* involvement 
in the content. Eye-contact, use of a variety of teaching strategies, 
interesting examples and illustrations are only a few of the ways to show 
the students that the instructor enjoys what he/she is teaching and 
enjoys teaching. The third way to assist student learning is to get them 
actively involved in class. The consensus was that passive students are 
not actively engaged in the learning pro'ce^s and, thus, do not learn as 
much as students who are involved somehow during the lecture. A fourth 
method for assisting student learning is for the instructor to be 
available to answer questions and provide personal help during his/her 
office hours. It is sometimes difficult to convince students to come see 
the instructor, so he/she must work at convincing the students that they 
are welcome and wanted during those hoursi-" The thing most often 
mentioned by students as being most helpful to them in .learning the 
course content is the scheduling of help sessions periodically during the 
semester. Many of the instructors who were interviewed concurred with 
them. And, finally, many of the instructors felt that taking attendance 
or giving "pop" quizzes also provide a means for the students to keep up 
in class and, thus, learn more. 

Instructional assistance, in the form of handouts, multi-media 
assisted lectures, controlled notes, etc. provide the students with 
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tangible asslstnce 1n organizing their learning. If complex theories or 
drawings are shown on overhead transparencies or slides, it is much 
easier for' the students to attend to what is being said about the topic 
if they are not frantically trying to transfer what they see on the 
screen to their papers. The instructors feel that this type of 
assistance is especially necessary. in large classes. 

Often it is difficult to get feedback ff'om students in large classes 
concernii.j their progress in learning the content or their opinions about 
the ins.^-.ruc tor's ability to convey the content to. them. Man^ of the 
instructors who were interviewed said that, they give relatively frequent 
short (1-3 questions) quizzes to obtain feedback on the students' 
progress with the content and they usually ask the students to provide 
some feedback to them on the back of the quiz about how they felt the 
course was going at that time. Also, research indicates that students 
who are tested frequently and provided with feedback on their progress 
learn the content better and retain it for a longer period of time than 
do those who are only tested once or twice--a semester (Bloom, 1980). 

Getting students to participate in large classes is usually very 
difficult. The size of the class makes many students reticent to share 
their ideas and many students also feel that if they ask a question they 
will be wasting the time of the other 100+ students in the class. To 
encourage student participation the instructors who were interviewed 
stated that the instructor must present him/herself to the class as being 
a very accessible person. Several things which provide this type of 
atmosphere are when the Instructor is courteous to the students who wish 
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to participate and when he/she uses positive reinforcement (i.e., "Yes, 
that's- an excellent idea") to let the students know their contributions 
are appreciated. In addition, if the instructor wishes for the students 
to answer questions, he/she must ask questions frequently, directing them 
to different people7~afid provide ample time after the question for the 
student to formulate an answer. 

Motivating students in large classes seems to be another area of 
concern for the instructors. For many instructors, grades are used. to 

motivate, students to ^tudy. Others try- to- -impart mot i-vat ton to the 

student^ through their own enthusiasm. Still others attempt to relate 
the content being discussed to their progress in future courses or to 
their future careers. Probably the most effective means of motivation 
consists of a combination of these techniques. 

Assigning homework (which will be checked) in a large class can 
become a real headache for th^' instructor unless he/she has ample graders 
or TAs to assist in checking it. Howevers^for some courses, homework is 
an essential part of the learning process. One suggestion for 
instructors of these courses is that the students be required to submit 
their homework on a standard size paper. This makes it much easier for 
the instructor to keep track of it. Another suggestion is to have all 
homework assignments returned in the smaller discussion sections. This 
takes much less class time. 

Frequently, when students get'in a large class, they tend to talk 
more during the class because they assume the instructor will not know 
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who 1s talking. The Instructors who were Interviewed agreed unanimously 
that the only method for dealing with this problem is to set down some 
rules right at the beginning of the semester and enforce them. These 
rules on classroom behavior should be put in writing and also stated 
verbally several times. The noise problom and Ineffective discipline or 
governing procedures in large classes were often stated by students as a 
source of frustration in large classes. 

Ways to personalize instruction . 

4 

; 

Students in large classes frequently state that they feel like 
nothing but numbers. They usually don't knbw the instructor and they 
also may never get to know the students who sit near them in class. The 
Instructors who were interviewed indicated that though one never knows 
all of the students in one's large classes, nevertheless, the students 
seem to appreciate any sincere attempt by the Instructor to learn the 
names and faces of as many as possible. There are several methods which 
can be used to help Instructors become acquainted with their students. 
One method is to have the students fill out a background information 
sheet the first day of class. This provides a little more information 
about each student than his or her name and thus makes it easier to match 
names with certain characteristics. Another method for getting to know 
the students is for the instructor to visit the labs frequently or lead a 
different discussion section each week. Students can also be encouraged 
to talk to Instructors if they stay a while after class. In addition. 
Instructors can provide an open invitation to talk with them in his/her 
office. Seating charts are also a valuable tool for learning names. 
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Several instructors indicated that students seem more willing to 
talk if they (the instructors) introduce themselves on the first day and 
. indicate why they are teaching the course and why they are interested in 
the subject* This little bit of self-disclosure makes the students feel 
they know the instructor on a more personal basis. 

The use of humor in lectures is also a way to "break the ice" with 
stucjents. Students frequently rate instructors who used humor to liven 
up their lectures as being more effective. Again, they probably feel 

t 

closer to the instructor because they know he/she has a sense of humor. 

One thing that the interviewed instructors stressed is the necessity 
of beginning and enrling on timel If the instructor indicates in this 
way, that class time is a valuable commodity, students will respond by 
arriving on time and not leaving early. 

Finally, instruction can be personalized if the instructor is 
receptive to all student questions an. treats the students as a group of 
individuals. Indicating a concern for the students through verbal and 
non-verbal actions helps break down the barrier in large classes. 

Level of main goals for classes. 
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One of the questions which was asked during the LCAP Interviews was, 
"What are your main goals for the students who are taking this course?" 
The goals which were stated were then categorized according to Bloom's 
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Taxonomy of the Cognitive Domain. The results are shown in Table 5.33. 
As we can see from this information, a majority of the goals for these 
large classes are at the Knowledge/Comprehension level. This may be 
because most of these classes are introductory courses, but in many cases 
it is because the instructors feel they have to give multiple-choice 
exams in order to get them graded rapidly. The instructors who indicated 
higher level, goals for their students also indicated that they give essay 
exams, either exclusively or in conjunction with other types of exam 
questions. 

/ 

Instructor comments about exams 

Giving exams in large classes seems to be the biggest problem faced 
by the instructors. It takes a great deal of time and clerical 
assistance to type, collate and staple 100+ exams. It also takes quite a 
bit of class time to pass out the exams and make sure everyone's exam has 

< 

all of the proper pages in the correct order and that everyone has an 
answer sheet. Due to the crowded conditjpns in many of the large lecture 
halls on campus, the instructor must develop 2-3 forms of the exam to 
deter cheating. This, also, is quite time-consuming. 

During the interviews the instructors were asked, what types of 
evaluation they used to determine a student's final grade. Their 
responses are given "in Table 5.34. This table shows that most of the 
instructors give objective exams and most of them give 3-4 exams during 
the semester. Totally subjective exams are only given by some of the 
instructors in Liberal Arts while sevjeral from Natural Science and one 
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TABLE 5.33 , 

Cognitive Levels for Main Goals of Large Class Instructors 



Department 

Economics 
History 
Government 
Psychology . 
Classics 

Astronorny 
Home Economics 
Geography 

Engineering 

Business 

Total 



Know./Comp , 
2* 



Level of Goal 
Appl i cation 



4 
1 



Anal ./Syn./Eval . 

2 
1 
2 



1 
1 



2 
3 

20 



2 
4 



32 



19 



* Number of instructors who, when interviewed, stated a goal which could 
be categorized into this level of Bloom's Taxonomy. 
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TABLE 5.34 

Forms of Evaluation Used in Large Classes 



Type of Evaluation 
College Paper Quizzes Homework.- 

Liberal Arts 
Natural Science 
Engineering 
Business 

Totals 



Types of Exams 
Obj. Subj. Both 




♦Number of instructors who, when interveiwed, said they evaluate students 
in this way. Some instructors used more than one method of evaluation. 
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from Engineering give exams which contain both objective and subjective 
questions. (Because some of the interviews strayed into other topics, 
the data do not necessarily represent responses to this question from all 
of those interviewed.) 

A major logistical problem in large classes is determining the most 
efficient* way to return exams and/or homework papers. If an instructor 
has a class of 200-500 students this process could conceivably take most 

« 

■of the class period. However, some of the instructors offered the 
following solutions to this problem: 

1. Place the exams/homework in boxes which have been 
alphabetized. These boxes ^ar'e then placed either on the 
stage at the front of the room or at spots around the 
perimeter, of the room. Call out several letters at a time 
and have students go to the box which is marked with the 
first letter of their last name. 

2. Have papers in folders which are alphabetized and let the 
TA come a little early and stay a little late to hand them 
out. " 

3. For returning homework, have them put their row number on 
the sheet before they hand it in and then pass them back by 
row. 

4. If the class has discussion sections, hand them back 1n 
those smaller groups. 

The task of assigning grades in a large class also poses a problem. 
This is because the grades in a large class tend to form. a continuum with 
no natural breaks between A's and B's or C's and D's. Because of this 
the large class Instructors who were interviewed have suggested that one 
must specify a point/grade policy at the beginning of the course and not 
deviate from it. Another suggestion is that large class instructors 
should either make the exams long enough or difficult enough so that they 
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can be scaled up. This makes the grades spread out more. And finally, 
several instructors suggested that large class instructors should use 
criterii^j;;ef^ence grading. Above all, they stress, set your standards 
and stick to them but always be extremely fair. 

Because of the crowded seating conditions in many, if not most, of 
the large lecture halls methods to deter cheating are necessary for each 
instructor to develop and use. The interviewed instructors stressed that 
students must know that cheating is not tolerated in the class jiid the 
instructor must know his/her rights as an instructor and the prof^^^^^^ 71 
methods for dealing with cheaters.. The best ways to deter cheating seem 
to be: (1) put space between each studenr'(if possible), (2) have an 
ample supply of/proctors in the room, (3) make up 2-3 forms of the exam, 
and (4) check each student's ID as he/she turns in the exam. This takes 
a lot of time, but it seems to be necessary. 

Though it doesn't happen frequently, instructors must be prepared in 
case a student decides to challenge his/her exam grade. The interviewed • 
instructors provided three possible solutions to the students' challenge. 

1. Make the student defend his/her answer in writing with 
references. 

2. For essay exams, let the student grade his/her own paper 
using the answer key, then have him/her defend that grade 
if there are discrepancies. 

3. Let any student who has a complaint bring it to you and 
you will re-grade the whole exam. (The grade will usually 
go down if the instructor rather than the TA grades it.) 
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Differences between large and small classes 



During the interviews the instructors were asked what they might do 
differently if they were teaching the content being presented in their 
large class to a smaller group. The primary differences centered on 
student involvement; the smaller the class the more student participation 
and involvement in the class. The major differences which they cited are 



listed below: 



(?) 
1. 
2. 

3. 
4. 



(+) 
5. 

6. 

7. 

8. 



Large 



(-) 
9. 
10. 
11. 



Lecture must be more formal. 
Feel like you are doing a 
service for the department. 
Must have good TA support 
Must establish control at the 
beginning of the semester. 

Gives instructor more of a 
"high". 

Students inclined to laugh 
more freely, clap and boo. 
Efficient method of information 
transfer. 

More diversity of opinion. 



(+) 
1. 

2. 



Small 



Students more likely to be absent. 
Students read paper. 
Students arrive late and leave 
early. 

12. Students talk in class. 

13. Takes more preparation time. 

14. Can't have much student 
participation. 

15. Can't get to know students or 
their weaknesses or strengths 

16. More physically and mentally 
demanding. 

17. The paperwork and record keeping 
are extremely time-consuming. 

18. The class spirit doesn't develop. 
The students remain individuals. 



More discussions. 
Can sense the level of 
student understanding. 
-3; Cover as much material 
as large class but with 
discussion. 

4. Students more attentive and 
participatory. 

5. Can build lectures 
around student questions. 

6. Students can do in-class 
presentations. 

7. You can assign more written 
work. 

8. You can have more reserve 
readings. 

9. You can skip over some 
of the material. 

10. You don't have to rely on 
AV aids as much. 

11. You can teach procedures and 
techniques. 

12. Can get to know the 
students. 

13. Can go more into the "meat" 

of a subject. 

14. Can be more flexible. 

15. Can give essay exams. 

16. Don't iiave anyone to assist, 
with AV aids. 
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Large (con't) 

19. Grading Is the hardest part of 
teaching a large- class. 

20. Must be very organized. 

21. Can't provide individual feedback 
to students. - 

22. You have to be a showman. ' ' 

23. Students won't ask questions 
in -class. 

24. Have to give objective tests. 

25. Cover less material because you 
feel you have to repeat more 
often. 

As can be seen from these lists, negative comments tend to predominate in 
the large class list while the comments about small classes are primarily 
positive. This indicates instructors have a more pos.itive feeling about- 
teaching smaller classes and a more ne^lWve feeling about teaching 
larger classes. Perhaps if more support were provided Tor large class 
instructors they would not enter this situation with such negative 
attitudes. 

Ideal Class Size 

When asked what size class they would prefer to teach 59.5St of the 
instructors who were interviewed said that they prefer classes with from 
1-50 students and 73.8% indicated they preferred classes with less than 
100 students (see Table 5.35). More of the instructors in Liberal Arts 
and Business like larger classes than do those in Natural Science or 
Engineering. The subject matter taught in the courses probably has a lot 
to do with the§e preferences. Problem solving and the other skills 
needed in the more technical fields can be taught more effectively with 
smaller teacher/student ratios in the classes. 

211 

232 



TABLE 5.35 
LCAp Instructor Class Size Preferences 









Class 


Size 






College 


1-15 


16-30 


31-50 


51-100 


101-200 200+ 


Totals 


Liberal Arts 


7* 


2 


5 


3 


1 3 


. 21 


Natural Science 




2 


1 


2 


2 


7 


Engineering 




1 


.3 






4 


Business 


1 


2 


1 


1 ■ 


4 1 


10 


Total 


8 


7 


10 . 


6 


7 4 


42 






16. 


23.855 


1 1 


16.755 9.5% 1 






1 


59.5% 






1 40.555 1 








73. d% 




25.2% 

« 




♦Number of instructors who chose this size ciass as the size they would 





prefer to teach. 



212 

233 



Characteristics of a good large class instructor 

When the Instructors were asked what qualities an instructor must 
have if he/she is going to be an effecfive and good large class 
instructor, the thing which they mentioned first was - 

"Show your students you really care about them." 

There was a unanimous faeling that if the ttudents feel that the 
instructor is concerned about each of them and their progress, they will 
work harder in the course and enjoy It more. There are many ways to 
communicate this concern, most of which were cited previously in the 
section entitled Ways to personalize instruction un p. 203. 

Along with caring about the students, an effective large class 
instructor should - 

"T^ke the students very seriously and let them know 
that you take your teaching very seriously." 

Students need to know that their ideas and comments are valued and 
welcomed during class. Instructors (especially in large classes) should 
never indicate verbally or non-verbal ly that a student's answer is dumb 
or worthless. If this instructor attitude is communicated to the 
students it will stifle their curiosity and creativity. It will also 
snuff out all student participation. 
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Though the class is large, the LCAP Instructors sti^essed that the 
good instructor - 



"Maintains eye contact with the class." 

r 

To do this the good instructor moves about during the lecture and looks 
directly at the individual students. This gives the students the feeling 
that the instructor is speaking directly to each individual. If the 
classroom has aisles, the good instructor will walk up and down the 
aisles while lecturing, maintaining eye contact while walking. The LCAP 
instructors all felt that the more the instructor brings the lecture out 
to the students, the better the studentr.f-eel about the class. 

ft 

Another extremely important quality which is exibited by good large 
class instructors is - 

"Enthusiasm about the subject." 

This Enthusiasm must show in the instructor's voice inflection, energetic 
lecture style, facial expressions, etc. This take5 quite a bit of work 
on the instructor's part, but enthusiasm is catching (and so is the lack 
of it). 

Along this same line of thought, a number of the LCAP instructors 
stressed that the good instructor - 
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"iias" got" to a pgrtwer «1 th- a persona that i s 
sonewhat different from the one you are from day to 
d5iy." 



Thus, even if the instructor is basically a shy person., it will help if' 
he/she can project the image of a person who is accessible and welcomes 
student-teacher interaction, both during and after class. This persona 
acquisition may not be necessary, however, for instructors who are , 
basically outgoing persons. (It seems, from our observations during LCAP 
and prior to. this study, that the most effective large class instructors 
are somewhat "hams" and enjoy "playing to large audiences.") 

A final quality which the LCAP instructors felt is necessary for 
effective large class instruction is - 

"Confidence in yourself and what you are doing." 

This\^iai;^ty is shown when the instructor demonstrates that he/she can 
cope with unexpected circumstances (e.g.. if the bulb blows in the 
overhead be able to continue on the board). This confidence in oneself 
is also manifested when the instructor take* responsibility for whatever 
happens in the class. For example, if the students come in. late, leave 
early, talk in class, etc.. the instructor is demonstrating a lack of 
confidence in his/her ability and right to govern by not settinn down and 
enforcing rules which deal with these student activities. 

Thus, the LCAP instructors who were interviewed see the effective 
large class instructor as a person who communicates his/her concern and 
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accessibility to the students (by eye contact, enthusiasm, learning 
names) while maintaining some strict rules for their in-class behavior. • 

• c 

Suggestions to the novice 

To a person who is faced with teaching a large class for the first 
time it can be an unnerving experience. To assist these first-timers, 
the LCAP instructors were asked to provide suggestions which they would 
give to someone who is in this situation. Their comments have been 
classified into three areas; Organization, Technique, and Discipline, and 
are listed below: 

Organization • *^ 

1. Be organized and consistent! 

2. Be ver y efficient in. managerial things'so the class flows 
smooERiyT This helps reinforce that you think class time 
is a precious commodity. 

3. Outline everything in explicit detail - have citations 
available if students aslc.^- 

4. Be prepared! 

5. Put all assignments in writing on a handout so they won't 
get misinterpreted. 

6. If you do calculations, show alj. the mathematics so they 
can see it. Make it precise so a student who hasn't worked 
with fractions or percentages or whatever for a few years 
will be able to follow what was done. 

7. You can be dull and boring, but it's better for the 
students if you are dull and boring in an organized 
fashion. 

Technique 

1. Talk to someone who has done it, and done^ it well!! 
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2. enthusiastic about the subject matter! « 

a<ej/ Don't teach anythlna^u aren't interested in (If 
possible)* 

* /' 

3. Use various teaching methods - lecture, discssion, AV 
aids, guest lecturers, etc. 

4. Deliver the information -Iti segments — don't lecture the 
whoTe time.* Leave time periodically for questions. 

5. Encourage student questions. 

6. Be able to present t>he material in a clear, organized 
fashion and in an interesting "nanner. 

7. You must have a sense of humor (not necessarily for only 
telling jokes, but for life in general). 

8. Don't get flustered; be in control 1 

9. Be incredibly, scrupulously fair 1 

10. Remember that it is a performance and that you are on 
stage and better look good. Yru must work at it (the 
presentation) all the time and you are never satisfied. 

- You must be prepared. - - 

Discipline 

1. Get control and establish rules of behavior at the very 
beginning. 

2. Be. sure the students know that you care if they learn. 

3. Encourage study throughout the semester - not just before 
exams . 

4. Don't let grades get too high on the first exam. 
Attendance tends to nosedive If you do. 



Though this may seem like a great deal for the novice large class 
instructor to remember and attempt to do, the experiences of these 
Instructors as well as those interviewed by Brock (1976) at Kansas State 
University, indicate that keeping these things in mind can make teaching 

« 

a large class a better experience. 
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Miscellaneous comments 



Throughout .the-' interviews with the LCAP instructors there were times 
when the instructors ^ould mention something which affected their 
teaching in large Clashes, but the statement was difficult to classify 
into one of the major categories being used by LCAP staff. These 
comments provide some valuable insights into large class Instruction and 
It was felt they should not be omittfed from this sumnary. (These 
comments are written below. No attempt will be. made to comment on these 
statements; they are self-explanatory.) 



1. There is a difference between teaching Fall and 
Spring; Spring classes seem to jell much faster. 

Z, The point must be made thatsize affects the 
quality of the enterprise. 

3. There are only two reasons to have a lecture. 

One is that the information being conveyed Is not 
published. The other is that the audience Is 
incapable of reading. 

4. Because we are overcrowded* and under-staffed, 
though we have excellent facilities and excellent 
courses (in Engineering), the students are 
probably learning a little less. They are 
getting less valuable experience. 

5. The students have commented that they. felt their 
writing skills have really suffered here because 
they are never asked to write anything. 

6. Good students seem to feel that frequently their 
comprehension is not adequately judged uecause 
one cannot give essay exams in a large class. 

7. Students feel that their attention in class 
suffers because of the cramped conditions in many 
of the rooms. 
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8. In the article In the UT Most on the "Best and 
Worst Professors in the Univer.sity", it was 
interesting to note that all of the professors 
who were cited as being really good professors in 
large classes have similar characteristics: 
entertaining, active, caring and perhaps overly 
dramatic. 



Recommendations to the Administration 



During the interviews the instructors were asked to provide us with 
some suggestions, which could be passed along to the administration, 
concerning things which they felt could be done to improve the quality of 
teaching/ learning in large classes -here at UT. These recommendations 
have been divided by College and are listed below: 



Liberal Arts 

1. Control over TAs at the end of the semester so they don't 
leave without completing the griding, etc. Perhaps a 
release on their last paycheck. 

2. Large classes should be 4 hr. courses with the 4th hr. 
being a^discussion section. 

3. Instructors of large cla<ises should have 6-weeks summer 
<:alary support one summer to reorganize or develop the 
course and develop and/or find more visual aids. 

4. Provide more assistance for entering Freshmen during 
Orientation on how to get along in large classes. 

5. Large classes should only be assigned to people who want to 
teach them. 

6. Recjo> ition of some sort should be given to people who 
teacft large classes. (As though it were important and 
appreciated.) 

7. Provide money for more TA assistance so there can be more 
written wr^K assigned and more discussion sections. 
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a. Do away with the Pass /Fail system. It makes students 
apathetic toward a course. 

9. Provide more funds for AV aids. 

a. Provide, say, $200/semester for each large course for 
materials. This needs to be a budget item and not in 
the departmental operating budget. 

10. Improve the atmosphere in large cUssrooms by painting them 
bright colors and decorating them in some way. 

11. Need more large lecture halls with media facilities that 
are designed for teaching! 

a. Someone from CTE should be on all planning committees 
for new teaching facilities. 

12. Need more medium-range auditoriums which seat 100-120. 

13. Make sure people who become TAs can speak and write 
English! ' 

14. Need more smaller classrooms in wh4-ch to break up into 
discussion groups. - 

15. Need a nice AV Library with equipment. We have an 
excellent book library, why shouldn't we have an excellent 
AV library? 

16. 398T courses should concentrate more on presentation skills 
and not so much on writing test items. 

a.. CTE should be given more people so they could teach it 
- the TAs would learn more. 

17. Have the CIS percentiles compared only among large classes. 

is! Stop hassling people with large classes. Give them more 
time to get grades in so they could give something besides 
multiple-choice exams. 



Natural Science 

1. Need to have plenty of blackboard space - especially in 
math. 

2. Need more TAs and graders. 

3. Provide money to hire proctors for exams in large classes. 

4. Put more emphasis on teaching in personnel decisions with 
more objective evaluations of it. 
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■ . \ 

5. Don't put young novice faculty into large class^; let them 
teach some smaller classes first to learn about t^e 
teaching process. , \. 

6. Make It clear that good teaching Is valued here at UT and 
that It Is a skill that can be Improved. \^ 

7. People who teach large classes should want to teach them. 
Eng^lneerlng 

1. Are we letting economics dictate too much? Is the level of 
confidence as high In large classes as In small classes? 

2. Put some pigeon-holes outside the rooms for handing back 
papers. 

3. Put more money and time Into the frequent checking and 
repair of equipment In rooms (i.e., overheads). 

4. Limit enrollment via academic qualifications either at the 
beginning level or at some intermediate level. 



Business 

1. Spend a little more time and money in the maintenance of 
buildings and equipment. 

2. Screen those who will be teaching large courses to make 
sure they want to and can! 

3. Persons who teach large classes should get additional help 
in the form of TAs, graders, proctors, clerical assistance, 
etc. 

4. University needs to have a standardized form for listing 
mass lectures with discussion or lab sections listed in the 
class schedule. 

5. Rennovate BEB 151 - it is a terrible rooml 

6. Give Instructors release time before they begin teaching 
one of these big classes to prepare. 

7. The reserve procedure in the library needs to be 
streamlined. It takes 2-3 weeks to get something put out. 
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8. It would be very helpful to have a room (like a mail room) 
where students could go to pick up exams and homework. 
Have one of these rooms in each building with alphabetical 
slots. 

Summary of Recommendations «^ 

In looking over these recommendations they appear to fall into three 
major categories. First , the instructors feel that the facilities and 
equipment could be better maintained to provide a better atmosphere in 
which to teach these classes. Many instructors who use visual aids to 
enhance their lectures frequently are faced with malfunctioning equipment 
which causes them a great deal of frtistfation. Many also feel that the 
students would learn more effectively (and this is supported by research) 
if the lecture halls were not so drab (Sommer, 1969; Sommer, 1974), 
Second , there seems to be a lot of concern in the area of TA support. 
According to the findings of this study (see section on Cognitive Levels 
of Professor's Evaluative Instruments , p. 164) students feel they learn 
more and they enjoy classes in which-they are tested via essay exams or a 
combination of objective questions and subjective (essay) questions. In 
order to test the students' knowledge in this manner, however, the 
instructor must have ample TA/grader support. Most of the instructors 
interviewed stated that they need additional TA support if they are going 
to use essay exams and/or papers to test the students' understanding of 
the content. And third , there needs to be more evidence from the 
administration that teaching is an important function in the university 
(i.e., without it there would be no University). This evidence could be 
povided in many ways: (1) if the administration would act on ^he first 
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two recoimendations stated above; (2) 1f ^acuity meoibers were encouraged 
to Improve and update their courses periodically, with the administration 
providing summer salary for several weeks to accoupllsh this task; (3) if 
funds were designated for each class to enable Instructors to develop and 
use slides, transparencies, handouts, .^nd films to promote greater 
student learning,- and (4) if the administration would acknowledge that 
teaching well takes a great deal of time and effort but the results are 
well-educated, satisfied students. (For additional ideas for 
rewarding/recognizing teaching, please see article "Creating New Rewards 
for Faculty" in Appendix 6.) 
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APPENDIX A 

SAMPLE FLIER SENT TO LARGE CLASS INSTRUCTORS 
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Please fill out and return this portion. 

I am interested in participating in the following 
phase of the Large Class Analysis Project: 

Direct Observation phase 
Interview phase 

Name: — 

Dept: - 

Campus Phone: — ^ 

One of our staff will contact you with more infor- 
mation. 



Return to: 

Dr. Karron Lewis 

Center for Teaching Effectiveness 

Main 2202 
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PLEASE JOIN US IN JHE 

LARGE 
C L AS S 
ANALYSIS 
PROJECT 



A STUDY OF COMMON ATTITUDES 
AND PRACTICES IN LARGE CLASSES 
AT UT 

CONDUCTED BY THE CENTER FOR 
TEACHING 
EFFECTIVENESS 



WITH FUNDS PROVIDED BY 
THE OFFICE OF THE PRESIDENT 
THE UNIVERSITY OF TEXAS AT AUSTIN 
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Many faculty teach classes of 100^ and there are 
more to come. To assist the faculty in dealing with 
these classes, the Office of the President has pro- 
vided funds to conduct a study of large classes dur- 
ing the 1980*81 academic year. This pamphlet is to 
acquaint you with the study and to solicit your par- 
ticipation and help. 

TYPES OF PARTICIPATION 

The study will be conducted at two levels of faculty 

participation: 

A. DIRECT OBSERVATION: A total of 20 instruc- 
tors ( 1 0 each semester) in the colleges of Busi- 
ness Administration, Natural Science, Liberal 
Arts and Engineering will be needed for the di- 
rect observation part of the study. This will in* 
volve the following: 

1 . having a student attitude survey admin* 
istered at the beginning and end of the 
semester (20 minutes each time) in one 
large class: 

2. keeping a log on the large class giving 
the instructor's comments and impres* 
sions about the '*care and feeding" of 
that large class; 

3. allowing a LCAP staff member to sit in 
on one class meeting a week to observe 
the types pf activities which commonly 
occur; 
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4 sitting with a LCAP staff member for a 
ri0*45 minute interview about your 
large class; 
6. audiotaping 4 class periods for more ac- 
curate analysis of any questions posed 
during the class. 
Any instructor interes*dd in participating at this 
level can have a fuller explanation of the plan by 
contacting us at 471-1488. 

B. INTERVIEW; A total of 50 additional large 
class instructors are being asked to dis- 
cuss the "care and feeding" of large 
classes with an LCAP staff member in 
an hour interview to be scheduled at 
their convenience during the semester. 
The interview will be taped and the ideas 
and suggestions given by each instruc- 
tor will be added to the rest to compile a 
list of recommended practices. 

At the conclusion of the study we hope to: 

1. learn what it is about large classes 
which students like and don't like and 
h )w that affects their learning; 

2. learn what it is about large classes that 
instructors like and don't like and how 
that affects their teaching; 



3. identify problems in large classei which 
are common in different disciplines; 

4. identify problems which are unique to 
certain disciplines; 

5. identify alternative solutions to the 
problems of large classes: 

6. identify the^ levels of thought which are 
commonly taught in large classes; 

The final product will be a booklet on large classes, 
common problems encountered and suggested so* 
lutions to .iMeviate those problems based on the ex- 
ptriences of the faculty (lera at UT. For the 
individual participant, ii will provide an opportunity 
to explore his or her own thoughts on the teaching 
of large classes and share that experience with col- 
leagues. 

We hope you are intrigued enough with the idea 
of this study to volunteer your time and ideas. We 
particularly hope you are interested in participate 
ing in the Direct Observation component and we 
welcome the opportunity to explain it to you in 
more detail. If you are interested in being a contri* 
butor to this study or if you would like more in- 
formation, please fill out the reverse side of this 
form and return it to the address indicated. 



254 



APPENDIX B 
STUDENT 4TTITUDE SURVEY 



255 

231 



LARGE CLASS ANALYSIS PROJECT 



Universities the size of Texas are faced with the prospect of having more and 
more large classes. In an effort to determine ways to make these classes useful 
learning experiences for students, the Office of the President has made funds 
available to the Center for Teaching Effectiveness to study student and faculty 
attitudes and ideas about large classes. We appreciate your cooperation in 
help.ing us conduct this important study. 



SECTION I: Please mark your responses to each item on the separate answer sheet. 
Columns 

1-4 The last 4 digits of your social security number 

5 My classification is: 

1 = Freshman 2 = Sophomore 3 = Junior 4 = Senior 5 « Other 

6 My sex is: * - 

1 = Male 2 = Female 

7 How many large (100+ students) classes have you attended before this one? 

1 = none 2 = one 3 = two 4 = three 5 = four or more 

8 Is this class: 

1 » elective 2 = required 

9 Do you think you are going to enjoy attending this class? 

Yes, very much No, not a^J all 

1 2 3 4 5 

10 The college or school in which you are enrolled is: (Mark only one response) 

0 = Liberal Arts 4 = Business Admin. = Education 

1 = Engineering 5 = Fine Arts 8 = Communication 

2 = Pharmacy 6 = Architecture 9 = Other 

3 = Nursing 



SECTION II: There are many things that an instructor does in class or. builds 
into the course materials that are designed to help students learn 
efficiently. Below we have listed some of the things that other 
students have said were useful to them. PLEASE RATE THE FOLLOWING 
ITEMS BASED ON THEIR IMPORTANCE IN HELPING YOU LEARN . Use the 
scale below to respond to items 11 - 19. 

1 - not important at all 4 - quite important 

2 - somewhat irportant 5 - extremely important 

3 - moderately important 
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LARGE CLASS ANALYSIS PROJECT - page 2 

n. Having the course topics and assignments aimed directly at your interests. 

12. Feeling at ease when you talk to the instructor individually. 

13. Being challenged by the material and the instructor to think for yourself. 

14. Being able to control the pace and manner in which you learn. 

15. Having the course material and assignments well organized. 

16. Being able to actively participate in class. 

17. Getting frequent feedback on your progress. 

18. Having strong outside support material, like the text and supplementary 
readings. 

19. Having an instructor who is very knowledgeable in the subject. 

If there is something you feel is important to your learning which we have left 
out, please describe it briefly on the sheet provided. 



SECTION III: Your Preferred Class Size. Rank the, following size classes according 
to the size class in which you feeJ you learn most efficiently. 

(#1 = most preferred class size #5 = least preferred class 

size.) 

20. less than 15 students 

21. 16-30 students 

22. 31-50 students 

23. 50-100 students 

24. over 100 students 

What is it about a class of the size you have ranked #1 that usually makes it so 
effective for you? (Please respond on the sheet -provided.) 



SECTION IV: There are a lot of statements made about the pros and cons of large 
versus small classes. We'd like to get your reactions to some of 
these statements. Please use the scalfe below to indicate the extent 
to which you agree or disagree with each of the following statements. 

1 - disagree strongly 

2 - disagree moderately 

3 - no opinion 

4 - agree moderately 

5 - agree strongly 

AS CLASSES GET LARGIR — 

25. I get loss feedback on how well I understand the material during the semester. 

26. I feel less like a participant in the class. 
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URGE CUSS ANALYSIS PROJECT - page 3 

27. Instructors seem to put more effort into the organization of the course. 

28. The course content becomes mostly facts to be memorized. 

29. I have the opportunity to take more responsibility for my own learning. 

30. A good textbook and relevant outside readirigs become .nore important to my 
understanding of the content. 

11. The pace of the course becomes less geared to the students '^ace of learning. 

32. I have more control over how involved I am in -he class. 

33. I am less likely to get to know other students in the class. 

34. The material in the course can be covered more efficiently." 

35. I'm less challenged to think for myself. 

36. I feel I have more freedom because I am part of a crowd and not so noticeable. 

37. The course is usually taught at a lower intellectual level than I like. 

38. I am less likely to seek out the instructor^for individual help. 

39. The overall quality of instruction seems to get better. 

40. I feel more distant frxxn the instructor. 

41. A students' inability to take good notes in class makes it difficult for 
him/her to do well on exams. 

If you have any additional ideas about large versus small classes, please tell 
us about them by writing on the sheet provided. 



THANK YOU 
FOR 

YOUR COOPERATION! 
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LARGE CLASS ANALYSIS PROJECT 
(Sheet for Additional Comments) 

SECTION II: If there is something you feel is important to your learning which we have 
left out, please describe it below. 



SECTION II: What class size did you rank #1? What is it about a class 

of this size that usually makes it so effective for you? 



SECTION IV: If you have any additional ideas about large versus small classes, please 
tell us about them below. 



i 
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APPENDIX C 

EXPANDED COGNITIVE INTERACTION ANALYSIS SYSTEM 

AND 

A 3RIEF EXPLANATION OF ITS USE 
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Expanded CIAS Categories 

1 - Accepting Student Attitudes 

Ih - Humor 

2 - Positive Reinforcement 

2f - Affective Instructor Comments 

3 - Repeating a Student RtfSponse 

3f - Corrective Feedback 

3b - Building on Student Response • 

4 - Questions 



4c 




Know1 edge/Comprehens 1 on 


4e 




Application (exampTes) 


4a 




Analysis 


4y 




Synthesis 


4j 




Evaluation/ Judgment 


t,f 




Affective 


4$ 




Process or Structure ' 


4r 




Rhetorical Questions 


4p 




Probing Quest-font. 


4d 




Calling on a student to respond 


Lecture 


5v 




Simultaneous Verbal and Visual Presentation 


5e 




Examples, Analogies 


5r 




Review 


5x 




Answering a Student Question 


5m 




Mumbling 


5t 




Reading Text Verbatum 



6 - Providing Cues 

6m - Focusing on Main Points 

6d - Directions 

6s - Assignments, Process 

7 - Criticism 

8 - Cognitive Student Talk 

8c-8f - Answers to Questions 4c-4f 
8n - Doesn't Know 
8q - Student Question 
8h - Student Laughter 

9 - Non-cognitive Student Talk 

0 - Silence 

Ob - Writing on Board ^without talking) 
Om - Mumbling (whole class) 
01 - Listening/Watching 
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Expanded Cognitive Interaction Analysis System Categories 



1 - Accepting Student Attitudes ; Comments that comrunicate a non-threaten- 

ing acceptance of student attitudes; student attitudes may be positive 
or negative; "You appear to be upset about this." "I'm glad to see 
you are a11 happy about the results from last week's test." "I realize 
this is somewhat difficult at first, bj^t you'll catch on in no time." 

Ih - Humor : Jokes or hur'-rous statements made by the teacher. This 
Is never negative, cjgrading or embarrassing in design or result. 

2 - Positive Reinforcement : Praising students; communicating a definite 

value judgment indicating that the instructor really likes what the 
student said or did; "Excellent!" "V^^y good!" "Exactly right!" 

2f - Affective Instructor Comments : Statements made by the instructor 
which reveal his/her own feelings; "I'm feeling good today." 
"I really enjoy this slide." "This is not my favorite section." 

3 - Repeating a Student Response ; Teacher statements which repeat in the 

same or very similar words a student comment. This indicates that 
the teacher has heard the student statement but does not indicate 
whether it is. correct or not . 

3f - Corrective Feedback : This includes negative statements which are 
non-punitive and non-threatening; saying "no" or "yes" or 
"That's correct" in a manner that provides feedback to students. 
This category would also include statements such as: "I dpn't 
want to deal with thit subject. now", or "I don't understand that 
question." 

3b •- Bu-jlding on Student Response : Teacher statements which build on 
the ideas of students. The teacher is developing the student's 
idea rather than his/her own idea. Ex: "As Tom stated, we can 
see that..."; "Let's deyelop Jane's idea a bit more."; "That 
ide(a suggests that..." 

4 - Question^ (If the level of the question cannot be determined, the 

observer \should code a numeral 4 with no subscript.) 

4c - Knowl edge/Comprehens ion : Factual (who, what, when, where) and 
Descriptive (describe steps) questions as well as questions which 
requiV-e the student to translate something into his/her own words, 
use art, equation to solve a problem, or translate a statement 
into an equation. 

4e - Application ; Questions which require the student to apply concepts 
to a specific situation or solve a problem where equations are 
not given. (Ex; "Can you give me an example..?", "How can we 
apply this...?") 

4a - Analysis ; Questions which ask the student to distinguish relevant 
from extraneous material or distinguish facts from hypothesis. 
(Ex: "What does this mean?" "Wi.y would... be true?") 
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Expanded CIAS Categories - p. 2 



Synthesis ; Questions whidh ask the student to design an original 
answer to a problem. (Ex: "Can we put these ideas into some 
pattern?") 

Evaluation/ Judgmen t: Questions which ask the student to judge the 
value of materials In terms of internal and external criteria. 
(Ex^ "Which is the best alternative?" "Is that conclusion right?") 

Affecti ve ; Questions which solicit student affective responses. 
(Ex: "Do you like...?" "How do you feel about that?") 

Process or Structure : Questions which relate to process including 
assignments or to the furthering of discussion. (Ex: "Are there 
any questions?" . "Is the assirtiment clear?" "Would you repeat 
that?") \ 

Rhetorical Questiohs : Questions for which the teacher clearly 
expects no answer from the students. 

Probing : Questions which ask a student to clarify his/her answer, 
those which give hints to desired responses, or those which refocus 
the response to relate it to something else. (Ex: "Could you 
elaborate on that?" "Why do you- say" that?") 

Calling on Student : Calling on a student by name (or recognizing 
a student's desire to participate) with the intent that the 
student should talk. 

5 - Lecture : Teacher statements which provide new information (not building 

on student information) to the students. 

5v - Simultaneous Visual and Verbal Presentati on: When a teacher uses 
a visual aid (overhead transparency, chalkboard, slides, etc.) in 
conjunction with the presentation of new material. 

5e - Examples, Analogies : The teacher provides verbal descriptions of 
examples or analogies to illustrate points in the lecture. 

5r - Review: The teacher reviews or restates concepts or facts discussed 
at an earlier time. (Ex: "As we said yesterday...") 

5x - Answering a Student Question : Factual statements made by the 
teacher in reply to a student's question. 

5m - Mumbling ; Teacher lecture which is very soft or otherwise diffi- 
cult to understand. 

5t - Reading Text Verbatupi ; Teacher reads directly from textbook, 
overhead transparency, slide, etc. 

6 - Providing Cues ; Statements which indicate the scope and/or sequence of 

the content to be discussed. (Ex: "Today we will be looking at...") 

em - Focusing on Main Points- ; Statements which emphasize the importance 
of specific portions of the content being discussed. (Ex: "The 
first main point I want you to remember is..." "Be sure you 
understand the importance of this paragraph.") 
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Expanded CIAS Categories - p. 3 



6d - Directions ; Statements which indicate that a student do something 
in response. (Ex: "L-ok on page 614." "Observe that blue line 
which separates the East from the West.") 

6s - Assignments* Process ; Statements which describe assignments or 
processes which the students are expected to complete. (Ex: 
"Your assignment for tomorrow isr. ." "Fill out the paper according 
to the directions given at the top of the page.") 

7 - Criticism : Negative, punitive comments; strong criticism; blaming 

students. (Ex; "That's ridiculous." "Don't interrupt me when I'm 
giving my lecture.") 

8 - Cognitive Student Talk ; Talk by students which is subject-matter 

oriented; recalling facts; expressing ideas or opinions about topics 
under study. (Student comments which pertain to the subject but are 
not teacher solicited ire recorded as 8 with no subscript.) 

8c - 8f - A nswers : Student answers to teacher questions 4c - 4f . 

8n - Doesn't know : Student states he/she doesn't know the answer to 

a teacher question. 
8q ~ Student Question : Student initiated question. 

8h - Student Laughter ; Student laughter as a response to an instructor 
comment or joke. 

9 - Non-cognitive Student Talk : Talk by students which is not related to 

the subject matter; management comments by students. (Ex: "Can we 
leave now?" or "We sure could use a break.") 

0 - Silence ; Three seconds or more of silence; pauses when no communication 
exists. 

Ob - Writing on Board or Transparency (without talking) ; Teacher 
writes on the board or transparency without talking. 

Om - Mumbling ; Periods when the entire class or sections of the class 

are talking and no specifiv: individual interactions can be discerned. 

01 - Listening/Watching ; Periods of riioe when the class is listening 
to a recording, watching slides or a filn: uP.d no verbal communica- 
tion is taking place. 
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cv pianatinn of the Use of CIAS 

The E)(panded Cognitive Interaction Analysis System is designed to 
record the verbal interactions which occur in classrooms in Higher Education, 
It consists of 45 categories into which the^ verbal interactions which occur 
in college or university classroom may be recorded. 

One category from this system is recorded every three'-seconds or 
when the interaction changes (whichever occurs first). The resulting 
sequence of numbers, provides an in-depth look into the /c.ual activity 
which occurred in the classroom. For example, it is possible to detect 
what happens after an Instructor poses a .question (4). If the observer 
recorded a zero (0) there were three seconds of silence following the 
question which allowed the students some "think-time". If the 4 is 
followed by an eight (8). a student immediately responded to the question. 
A 4 (Question) followed by a 5 (Lecture) indicates that the instructor 
either answered his/her own question or. when a student didn't respond 
immediately, the instructor decided to elaborate or explain a concept or 
portion of the question further. 

Using the total number of categories recorded, the observer can 
calculate the % of Teacher Talk which occurred as well as the % of Student 
Talk which >A place. The percent of time the teacher or students spent 
in^ any one cacego.ry can also be calculated to discover, say. whether the 
instructor spent an inordinate amount of time answering each student 
question . 



241 

265 



\ 



Explanation of CIAS - p. 2 

Thus, this system can provide a great deal of quite specific feedback 
concerning the interactions which occur in classrooms in Higher Education 
and this feedback can be productively utilized to assist instructors in 
modifying and improving their teaching skills. 
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QUESTIONS ASKED DURING LCAP INTERVIEWS 
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QUESTIONS ASKED DURING LCAP INTERVIEWS 

1. Which courses are you teaching or have you taught that are large? 

2. What are your goals for the students In these courses? 

3. What are your students like? (backgrounds, attitudes, etc.) 

General 

1. What kinds of things have you found that you can do which are most 
useful in helping the students learn? 

la. How are these different from what you would do in a small cluss? 

2. What do the students do that makes teaching a large class interesting? 

3. What do the students do that makes teaching a large class difficult? 

4. How do you motivate the students to learn? 

5. How do you encourage student participation? 

6. How do you evaluate student learning? 

6a. How do you write exams that are challenging but easy to grade? 
6b. Do you have suggestions about ways to give feedback to students? 

^Details 

1. How do you get to know your students ?_ Do you take roll? 

2. How do you handle office hours? 

2a. How many office hours do ynu keep? 

2b. How. many students do you ...ually see during your office hours? 

3. How do you coordinate lecture with the lab or discussion sections? 

4. How do you hand back papers and handouts efficiently? 

5. Do you use more handouts in a large class? Why or Why no:.? 

6. How do you grade efficiently and fairly in large classes? 

7. How do you get feedback from your students? (About how they feel 
the course is going as well as how well they have mastered the 
content. ) 

8. How do you keep the noise level duwn in large classes? 

24? 6 8 



Questions askcJ during LCAP Interviews - p. 2 

9. If you could teach any size class, what would be your preference? 
Miscellaneous 

1. Is there anyone else who has taught a'large class whom you would 
recommend we talk tc? 

2. Are there any othe'' specific questions you would like to see answered 
by this study?* 
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SUPPORT ASSISTANCE NEEDS SURVEY 
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LARGE CLASS 
SUPPORT ASSISTANCE NEEDS 
SURVEY 

NAME : DEPARTMENT : 

(Note: If you are not teaching a large class this semester please answer the 
survey for the class(es) you taught last semester.) 

1. What size classes are you teaching this semester (i.e., # students)? 

Class #1 ■ Class #2 Class #3 

2. How many TA hours do you have for each class? 

Class #1 Class #2 Class #3 

Do you have other forms of assistance (i.e., graders, proctors, etc.)? 

yes no How many? 

Could you use additional assistance? yes^ no 

How much more? hours . ' 

Currently, what are your TA's primary responsibilities? 

\ 

If you could get more TA time, what additional duties would you assign to 
him/her? 



3. Do you have access to secretarial assistance for the preparation of exanis, 
quizzes, and handouts? yes no 

If not, would this type of assistance for your largest classes be helpful 
to you? yes no 

Please comment: 
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4. Please (1) check the types of media assistance you currently use in your 
large classes and (2) circle those you would like to use if you could get 
access to them: 



chalk and chalkboard 

16 inn films 

si ides 

recordings (LP's) 

handouts (class session outlines 

readings, diagrams, etc.) 

For the items you circled above, what seems to be the major obstacle to 
your gaining access to them? 



overhead projector and 

transpariencies 

videotapes 

audiotapes 

other 
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Support Assistance Survey 2 
Are there any media services on campus that you use regularly? Which ones? 



5. What classrooms do you teach In this semester? 

Class #1 - Class #2 Class #3. 



Please describe how each of these classrooms could be improved to make it 
a more pleasant teaching/ learning environment: 



Classroom #1 - 



Classroom #2 - 



Classroom #3 - 



Have you taught a large class in any classroom on campus that you particularly 

liked? If so, which one was it? 

What characteristics made it such a good classroom? 



\ 



6. Please provide any additional comments below which you may have concerning 
the adequacy of the support assistance you have for teaching here at UT. 




Please return to: ' Karron Lewis 

Center for Teaching Effectiveness 248 
MAI 2202 
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PROGRAMMED WORKBOOK FOR CIAS 
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Programmed Workbook 
for Developing Coding Skills 
using 
Johnson's 

Cognitive Interaction Analysis System 
(CIAS) 



by 

Karron G. Lewis, Ph.D. 
Faculty Development Specialist 



Center for Teaching Effectiveness 
The University of Texas at Austin 
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Cognitive Interaction Analysis System (CIAS)* 
(*n "ating scale is implied) 



1. Accepting student attitudes . Cornnents that communicate a non- 
' threatening acceptance of student attitudes; student attitudes 
may be positive or negative; "You appear "to be upset about this." 
"I'm glad to see all are happy about the results from last 
week's test." 



2. Positive reinforcement . Praising students; communicating a 
definite value Judgment indicating that the instructor really 
likes what the student said or did; "Excellent!" "Very good!" 



TEACHER 
TALK 



3. Corrective/feedback . Includes negative statements which are non- 
punitive and nonthreatening; saying "no" or "yes" or "that's 
correct" in a manner that provides feedback to students; repeat- 
ing a studer\t's response so all students know the answer was 
..correct or acceptable. ^' ' 



7. 



Questions , r ' 'e rhetorical quest-ions; all questions rais^ed 
by the teacher; calling on. student by name to >espond to a 
ques -1 ^n. . 



Lect'jre. Coirmuni eating facts, expressing ideas, giving examples, 

> ... 



Providing cues/directions . Words tnat signal importance; "This 
is important to remember." "These next four items are very im- 
portant in our study." Directions the instructor expects the 
students to follow: includes procedu.\.l directions. 



dri cicism . Negative, punitive cornnents; strong criticism; 
Framing students; saying "Ridiculous" or "That's silly" or 
"Don't interrupt me when I'm giving my lecture." 



8. Cognitive student talk . Talk by students which is subject matter 
oriented; recalling facts; responding to teacher questions or 
directions with subject matter responses or subject matter 
questions; expressing opinion or ideas about topics under study; 
analyzing, synthesizing, evaluating; subject-matter questions 
raised by students. 



STUDENT 
"TALK 



9.. 



Non-cognitive st u dent talk . Talk by students which is not re- 
lated to subject . ..at ter; management comnent; by students; "Can 
we leave nOw?" or "Can we take a break?" or "Will we have the 
quiz tomorrow?" or "I went to the game Saturday and didn't have 
time to prepare my lesson." 
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C. Si lence . Three seconds or more of silence; pauses, wl^.en no 
communication exists. 
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Progranmed Workbook, for Developing Coding Skills 

. using 

Johnson's Cognitive Interaction Analysis Systtm 

(CIAS) 

\ 

This is a workbook which will help you learn to use the Johnson's 
Cognitive Interaction Analysis System t£ IAS) . An audio cassette recording is 
available to use with this workbook. '0^ ' - 

Prior to beginning this workbook, read the first twelve (12) pages in 
Johnson's Cognitive Interaction. Analysis System and Computer Program . Con- 
centrate on becoming thoroughly familiar with the ten basic categories in 
the Johnson's system (described in the table on page 1). This workbook will 
provide you with practice to he:lp you improve your skills in u<;ing the system. 
You' will progress more easily and rapidly if you have a definition of each 
category at hand. 

Directions 

This workbook is set up in the question-answer format which is usually 
found in self-paced programmed materials. The optional jassette tape 
recording is of actual classroom interaction episodes, which you are asked to 
code periodically as you acquire proficiency in the system. 

As you progress through the question-answer portion, you are asked to 
use a blank sheet of paper to cover all of the material belcw the question 
ycu are working on. As you complete each question or item, move the blank 
sheet down to reveal the answer; these are located on the left hanJ side of 
the page. Respond to each question by inserting the appropriate answer in 
the blank or by choosing between given answers. After answering each question, 
move the blank covering sh^et down to check your answer. 

If you are utilizing the cassette tape, when you reach specified points 
in the workbook, you will be asked to listen to a certain section of the tape. 
(These points are indicated by an asterisk - **. If you are not using the 
taped episodes, skip over the questions marked in this manner.) These tape 
selections are provided to test your skill in coding classroom verbal 
interactions utilizing what you have learned to that time. The taped selections 
will be incorporated most toward the end of the workbook when you are asked 
to code more involved verbal interactions. Directions for utilizing the 
taped selections are provided both on the tape and in the workbook. 

Guidelines for Coding CIAS 

Because severe problems may arise when you begin deciding into which 
category a verbal statement belongs, several ground rules or basic guidelines 
have been established. These guidelines will help you to develop consistency 
in categorizing instructor and student statem3nts. 

1. Do not record CIAS during the opening of the class session when the 
professor is dealing with management tasks (e.g., checking attendance) 
instead of cognitive aspects of the lesson. [Do note the time that 
this activity begins and ends and make a note about what type of 
activity is occurring.] 
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2. Begin to record CIAS when the professor and/or students engage in 
cognitive aspects of the lesson. Begin and end each coding session 
with a category 0 in order to enable both the first and last verbal 
interactions to be tallied in the matrix. Also, one assumes that 
each lesson which is coded begins and ends with silence (even 
though this may not actually be the case). 

3. Record the numeral representir,; the verbal interaction category in 
use — one every three-seconds. ''^ 

4. If more than one type of interaction occurs during a three-second 
interval, the observer records a category number for each change 
which occurs. If no change occurs within three seconds, the 
continuing category is recorded again. For example, within a 
three-second interval, the instructor may ask a question, a. student 
answers, and the instructor praises the student's response (4 8 2). 
The observer r.nould record all three categories. On the other hand, 
if the instructor lectures for more than three seconds, a series 

of 5's would be recorded until the interaction category changes. 

5. Category 0 (silence) must be a full three seconds in length before 
it is recorded. If five seconds of siTence was followed by a one 
second question, the recording would be one zero followed by cne 
four (0,4). If the beginning of a three-second period cT 

time had one second for a question followed by five seconds of 
silence, a four would be recorded followed by one zero (4,0). 

6. Category 1 is a nonthreatening feeling tone used by tho professor 
to express acceptance of positive or negative student expressions; 
includes jokes ti.at are not made at the expense or embarrassment 

of the student. (Ih in Expanded CIAS) The effect of an instructor's 
statement on the students and not what the instructor intended 
the crucial criterion for categorizing a statement. For example, 
if the instructor attempts to be clever and make a joke, but the 
students respond as though it were criticism, it would be recorded 
as a 7 and not as a 1 . 

7. Category 2 communicates a positive, enthusiastic rewarding of a 
student's comments. 

8. Repeating a correct student response is recorded as a category 3 
(if not repeated enthusiastically). 

9. Correcting a student response, in a non-punitive manner, is a 
category 3; e.^. , "No. The correct response is..." 

10. Rephrasing a student's comment in the form of a question is recorded 
as a category 4; e.q. , 

Student: "It is a desolate area and would deter growth pot$;ntia"i ."(8) 
Professor: "Are you saying that the location is isolated from 
modes of transportation?"(4) 

11. All teacher statements presented in question format, even rhetorical 
questions, are recorded as category 4; record a 4 when the tedcher 
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calls on an individual by name with the intent that the student 
• should talk; e.g., "Joyce?" 

12. All directions, including procedural directions, are recorded as 
category 6; e.g., "Review in your mind..." or "Over the weekend, 
read..." or "List these on your paper." 

13. When the teacher calls on an individual by name witn the intent that 
the student should follow some directions, record a 6; e.g., "John, 
go to the board and calculate your response" or "Bill" (indicating 
Bill is the next person to go to the board and work the problem).. 

14. Jokes made at the expense or embarrassment of the student are 
recorded as 7's. 

15. All student cognitive talk is recorded as 8's. If a student begins 
talking after another student {student-student interaction) a 
slash (8/8) is inserted between the 8's or 9's to indicate there 
has been a change of speaker. Unison group responses are recorded 
as an 8 (if they are content oriented). ' 

16. All student non-coynitive. talk is recorded as 9's. 

17. Do not use the cognitive interaction analysis system if the class 
views a 16 mm sound film, listens to a lengthy audio-tape, or 
spends the class time in silent reading. Merely record the time 
and write a comnent describing the situation. Wait until the 
instructor is again engaged in cognitive verbal interaction. 

18. When in doubt, record the category which Is congruent with the 
predomlnatit mood of the class session. For example, if the situation 
isn't a clear category 2 or 3, think about the previous statements. 
If the teacher has consistantly accepted student responses by 
.-epeating or rewording them instead of enthusiastically praising 

the student's talk, record a 3. 

19. When communication is undecipherable or when chaos exists, cease 
recording, note the time, and write a comment. When the class 
settles and cognitive interaction is reinstated, note the time and 
begin recording again. 

20. An observer records i. category 1 when thp inscructor recognizes the 
effects tha environment may have on studd-its. For example, if the 
instructor says, "The classroom is getti- watm" or "This slide is 
kind of dark", it would be recorded as a c iegory 1. 



Please turn the page and begin answering the questions. It is suggested 
that you use penc'l for writ'ng in your answers so that you will be able to 
change your responses if you wish to do so. Remember, if you are not using 
the tape recording, skip over ail questions marked with an asterisk (*). 
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One popular means for recordinn 
classroom verbal interactions was 
developed by Ned Flanders. It is 
called 



1. Interaction Anabais 



2. An adaptation of this system has 
been developed by Gienn R. Johnson 
for u^e in higher education. The 
adapted system is called . 



2. Cognitive Interaction Analysis 
System (CIAS) 



3. CIAS divides the verbal interactions 
which can be coded into three major 

sections. These are: a. , 

b. . c. 



teacher talk student talk, 
and silence 



4. 



The development of CIAS^wa? influenced 
by two prominent educational research- 
ers: a. and b. . 



Ned A. Flanders and Benjamin 
S. Bloom 



5. There are four major elements in the 
Quality of Instruction as stated by 

Bloom; a. . b. , 

c. . d. 



5. a. Cues used by \:he instructor 6. The categories which denote teacher 

b. Participation by the talk are , , , . 

students . » and . 

c. Reinforcement techniques the 
teacher uses 

d. Feedback/correctives provided 
by the instructor 



6.. Categories 1,2,3,4,5,6, and 7. 7. Student verbal statements are coded 

in categories and . 



7. Categories 8 and 9 8. Category tells us that 3 seconds 

of silence was observed by the coder. 



3. Category 0 9. An observer records a category 5 to 

indicate a type of teacher talk we 
often refer to as . 



9. Lecture 



10. When a teacher makes a statement such 
as "In the constitution of a country, 
the Supreme Court helps set traditions," 
the observer would code that statement 
as a category . 
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10. Cdtegory 5 



11. Explaining, discussing, giving an 
opinion or giving facts or informa- 
tion are all types of teacher talk 
which would be classified into 
category . 



11. Category 5 



12. Which category is the one recorded 
most often in a classroom observation 
using CIAS? 



12. Category 5 



13. Category-4 



14. Category 4 



13. When a teacner asks 
observer would code 



a question an 
a category 



14. When a teacher asks a rhetorical 

question such as "When an instructor 
starts a particularly smelly demon- 
stration in the front, faf the lecture 
room, it takes several minutes for 
the -ador to reach the back of the 
room, • How can this be ijF the smelly 
molecules are moving so rapidfly? 
Simple, the smelly molecules.. ," . 
really expecting no definite answer 
at that time, the observer would 
classify this as category . 



15. "What is the best time of day for 
choral rehearsals'^' is an example of 
a teacher stateme ^ which would be 
included in cat'»gory . 



15. Category 4 



16. A student's answer to a teacher's 
question would be recorded as a 
category . 



16. Category 8 



17. Category 8 



17. Any student statement which is 
obviously a response to a teacher 
question, direction, or statement 
would be coded in category . 



18. T: Mark, who wrote musij which sounds 
very similar to this? 
S: I don't know. It all sounds the 
same to me. 

In the interaction .*.buve, the student 
response (would, would not) be coded 
as a category 8, 
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18. 



Would. Even though this is 
not the answer the teacher 
expected , it still concerns 
the student's grasp of the 
content. 



19. 



In the following dialogue, Identify 
the category for each lettered 
statement. Letters appear following 
each statement. 



T: 



S: 
T: 



S: 



Boili 

which 

Itqui 

Me.lti 

what, 

Melti 

liqui 

A thi 

subli 

gas. 

of a 

that 



^ja> to 
solid to 



ng is a phase change in 
a substance goes from the 

d to gas phase, a. 

ng is going from wHaJ 
David? b. 

ng is going from 

d.. c. 

rd type of phase change, 
mat ion, is from solid to 

d.^ Can anybody think 

good example of something 
sublimes? e. 

f. 



19, a. 5 d. 5 

b. 4 e. 4 

c. 8 f. 8 



'20.- Now you are going to have an opportunity 
to practice what you have learned so 
far.- -While listening to Segment #20 
of your cassette recording of a 
t.-jacher and a class, code the state- 
ments you hear using the four cate- 
gories discussed so far (0,5,4, and 
8). Throughout this sectirn you 
will hear a "ping" sound periodically. 
Record the category for the verbal 
statement just completed immediately 
upon hearing each "ping". Record 
your numerals in vertical columns to 
facilitate future interpretation. 
Use the space to the left for 
recording your categories. 



*20. You should have recorded the 

following: (To conserve space, 

the categories are given below 
horizontally in groups of five, 

Mark your tallies off in groups 
of five to assist you in 
comparing your data.) 

00555 54808 88888 84884 88348 88855 
55o55 55555 54488 8880 



^21. When the coding of Segment §20 
of the tape is clear to you, 
r on to the next item. 



'21. If your answers were incorrect or 
if you Qisagree with any of the 
answers at the left, ask your Instructor 
to clarify your specific questions. 
If necessary, replay this portion of 
the tape and code it again. 



22, 



One of the rules fo- ".oding ve-*«al 
interactions using GIAS is that you 

record a category every ^ seconds 

or when a in interaction 

category or speaker occurs, whichever 
comes first. 
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22. Record a category every 3 *23. 
seconds or when a change 
in interaction category or 
speaker occurs. 



Timing in coding CIAS is relatively 
important. To get some practice in 
"feeling" the S-sennd Interval, 
Segment #23 of the wape consists of 
a straight lecture. All you do is 
record a "5" every 3-seconds. At 
the beginning of the tape a "ping" 
will occur every 3-seconds but it 
wil Vdisappear toward the end of 
the tape segment. Record your 
3-second practice drill in the space 
at the left. 



^23. You should have recorded a 
total of approximately 88 
category 5's. You should 
have recorded approximately 
64 ta Pies after the "ping" 
stopped. 



24. 



How did you do? If you had some 
trouble after the "pings" ceased, 
try tapping your foot lightly as if 
you were marching. You should 
tap your foot twice every second 
at a march tempo. 



25. 



When a teacher accepts a student's 
idea without placing a value 
judgment upon it, we code that as 
a category . 



25. Category 3 



26. Very often a teacher may shift from 
building on a student's idea (category 
3) to giving his/her own ideas 
(category 5). For example: "As 
Rick said earlier, if we add NH3, 
lead will precipitate. But NH3 will 
also react with some ions in a 
different manner. When we add NH3, 
copper will form a soluble deep 
blue complex." 

"As Rick said earlier..." is category 



26. Category 3. The second and 
third sentences are caterjory 
5 bP'-ause the teacher begins 
initiating his own ideas. 



27. Is this teacher'? statement 
his/her own idea or that of 
the student? 



27. To detemin ,viip»ther or not a 

teacher sta'.ement should be coded 
as a categor • 3 tha coder should 
ask him/herself • 



28. When a student answers a teacher's 
question, and ^.hen the teacher 
repeats the student's answer, the 
teacher statement would be recorded 
as a category . 
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28. Category 3. Repeating a 

s .udent's response is always 
classified as Category 3. 



29. When the teacher says, "No, Joe, 
that's not quite right," this 
would be recorded as a category 



29. Category 3. Negative state- 
ments which are non-punitive 
and non-threatening and 
provide feedback to the student 
concerning the correctness 
of his answer is recorded 
as a Category 3. 



'30. Segment #30 of the cassette tape is 
a short progress test to see if you 
know the five categories we have 
covered so far and to determine if 
you have developed a 3-second 
"feeling" for coding. REMEMBER: 
Record another number every 
THREE-seconds — OR when the behavior 
CHANGES. Record your CIAS in the 
space at the left. 



*30. You should have recorded: 

04448 33888 88888 88888 84888 88883 
88848 88888 88888 48448 48348 34834 
880 

If you disagree with a code 
replay the tape and look at 
a watch as you read these 
codes. 



31. When a teacher uses praise or 

encouragement, what category would 
you record it in? 



31. 


Category 2 


32. 


Is a -Statement like, "Uh,huh, 
continue", classified as a 
•categor; 2? 


32. 


Yes. Any form of verbal 


33. 


"That's right, Dave. Exactly right," 




encouragement is classified 




would be categorized as a category 




as a category 2. 




• 



33. Category 2 



34. When a teacher indicates that a 
student's answer is correct by 
nodding his head, that (is, is not) 
coded as a category 2. 



34. Is not. CIAS concentrates 
solely on the verbal 
iiit3ractions. No non- 
verbal signs or cues are 
coded. 



35. In the following dialogue, identify 
the category number for each letterecf 
statement. Letters appear following 
the responses: 
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T; The Sinfonia of the 17th Century 
was a predicessor of the Symphony 
as we know it. a. It was 

often used to Introduce vocal 

compositions, b. ^ Where 

do we remember hearing that it 
occurred most, however? c. 
Jackie, where would people"o7 
ffie 17th century usually be 
when they heard a sinfonia? 

d. - 

S: At the opera, e. 

T: Exactlyl f. How was the 

sinfonia incorporated into an 

opera? g. ^ 

S: They were used like overtures 

and in-between acts. h. 

T: Right, i. And because of 

this, they were often composed 
"on the spur of the moment", 
j. Did the audiences 

-uaually pay much attention to 
these instrumental interludes? 
k. 



35. a. 5 d. 4 g. 4 j. 5 *36. Practice 1n recognizing and recording 

b. 5 e. 8 h. 8 k. 4 teacher reinforcement (Category 2) 

c. 4 f. 2 i. 2 is contained in Segment #36 of the 

cassette tape, as well as the five 
categories learned previously. 
Record your CIAS in the space at 
the left. 



*36. You should have recorded: 

05555 55554 48888 88884- 88888 88888 
24888 88555 55444 84835 56648 44888 
85544 88823 34444 88888 84822 0 

If you have discrepancies 
or any questions, ask your 
instructor for clarification. 



37. Talk by students which is not 
related to the subject matter 
recorded as category . 



is 



?7. Category 9 38. If a teacher asks, "When did 

Mendeleev publish his periodic 
table?" and a student replies 
"1869", the student's response is 
recorded as a category . 



38. Category 8 



39. If the student above had replied 
instead, "Will we have a quiz 
tomorrow?", his response would be 
coded a?; a category . 
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39. Category 9 



40. Category 6 is defined as 



40. Providing cues/directions 



41. A statement such as "Larry, please' 
list all of the ions in Group IV 
on the board," would be coded as a 
category . 



/ 



41. Category 6 



42. A statement such as "You remember 
from an earlier lesson we discovered 
these genres of literature," would 
be coded as a category . 



42. Category 6. Providing cues 
to important information is 
coded as a category 6. 



"43. The next segment of tape (Segment 
#43) includes all of the categories 
covered thus far (0,5,4^,8,3,2,9,6). 
Remember to record one' category every 
3-seconds or whenever the verbal 
interaction changes. Record your 
CIAS in the space at the left. 



*43. You should have recorded: 

06655 55555 48235 55566 56004 
82490 



44. In the following dialogue, identify 
the category number for each lettered 
response. Letters appear following 
each statement. 



T: 



S: 
T: 

S: 



T: 



S: 
T: 



S; 



Now we've all seen the film, 

•Deliverance , a. And, I 

want us to think just for a few 
minutes what qualities of drama 

this film illustrates, b. 

Ray, what kind of film do you 

think it is? c. 

It's suspensefuTl! a._ 

It's suspenseful! e. I 

agree! YesI f..^ Patty? g. 

In some way it's concerning 
the situation about. . .perhaps 

the environment, h. 

Yes! Right! i. The 

environment! j. , what 

ways specifically? k. 
The destruction of it. 1 . 

Ah! Very good! m. ^ Tne 

destruction of the environment. 

n. The... go on. o._^ 

The destruction of it. ..then also 
. . . p. 



ERIC 



261 

285 



\ 



12 



T: Well, actually, what were they 

doing? q. 

S: They... for industry... for... 

r. . 

T: They were going to build a dam. 

s. 

S: Uh, huh. t-^ 

T: Right! GooITi r Rick, what 

frlse might this film concern? 

V. 

S: Will we be seeing some more 
films? w. 



44. 



a. 5 

b. 6 

c. 4 

d. 8 

e. 3 

f. 2 

g. 4 

h. 8 

i. 2 
j. 3 



k. 4 
1. 8 
m. 2 
n. 3 
0. 6 
p. 8 
q. 4 
r. 8 
s. 3 
t. 8 



u. 2 
V. 4 
w. 9 



'45. Segment #45 of the cassette tape will 
give you practice in recognizing all 
of the categories studied thus far. 
Record your coding in thft space at 
the left. Remember to /-ecord one 
category number every 3-seconds o.' 
whenever the verbal interaction 
changes . • 



*45. You should have recorded: 

04488 23483 24455 44832 34400 44455 
55666 66555 55560 05445 54888 83346 
6550 

If you made any mistakes or if 
you disagree, ask your 
instructor for clarification. 



46. Accepting student attitudes 



47. Category 1 



46. is the phrase 

which describes the statements we 
classify into category 1. 



47. "That's kind '-f tough to read, isn't 
it?" is an example of a category 



48. "That's good work, Dave", is an 
example of a category . 



48. Category 2. Be sure you 49. When the teacher says "Pve often 
see the difference between felt that way myself", the coder 
a category 1 and 2. records a category . 
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49. Category 1 50. "That's an interesting idea, Jim", 

is an example of category . 



50, 


Category 2 . 


51. 


"Who can review for us the steps we 
need to follow for 'this experiment?" 
wouTd be coded as a category 


.51. 


Category 4 


52. 


"If you students are going to talk, 
please leave the room", is an 
example of a statement, which would 
be coded as a category 


52. 


Category 7. This statement 
is intended to criticize the 
students' persistent 
talking. 


53. 


"Look at page 472, problem 18" would 
be coded "s a category, 6. (True , 
or False) / 

/ 



53. True 54. What phrases and/or words are used 

to describe category 7? 



54. Criticism 55. "I'm the teacher in this course — 

unless, of course, you think you 
know more than I do about this 
subject!" would be classified as 
a category • 



55. Category 7 56, What distinguishes a category 6 from 

a category 7? 



56. A category 6 is recorded when 
the teacher is merely giving 
directions or providing feed- 
back to the student and there 
is no criticism implied. On 
the other hand, category 7 is 
recorded when a teacher 
either criticizes a student 
or defends his capabilities 

: or position. 



*57. This next tape segment corresponds 
to Question 57. Record CIAS on 
this segment paying special 
attention to categories 1 and 6. 
Record your categories in the 
space below. (REMEMBER: Record 
one category every three-seconds 
or when the verbal interaction 
chaages.) 
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♦57. You should have recorded: 58. 

04444 44811 44844 88366 66448 83166 
66666 66666 66660 64666 66444 6660 



If you made any errors, go 
back over the tape segment 
and try to get each category 
straight in your roind. 



Write the key words or phrases which 
describe each of the Cognitive 
Interaction Analysis System 
Categories below: ^ 



1. 
2. 
3. 
4. 
5. 



6. 
7. 
8. 
9. 

10". 



58. 1. Accepting student attitudes 

2. Positiv^\ reinforcement 

3. Corrective/feedback 

4. Questions 

5. Lecture 

6. Providing cues/directions 

7. Criticism 

8. Cognitive student talk 

9. Non-cognitive student talk 
10. Silence 



^59. Two more rules concerning the coding 
of CIAS need to be emphasized dt 
this point. First , a category 0 
is recorded whenever a 3-second 
period or longer elapses in which 
there .is silence. Silence is often 
very, critical when analyzing teacher- 
student interactions. It is 
important that it be recorded 
accurately. Second , when communica- 
tion is undecipherable or when chaos 
exists, cease recording, note time, 
and write a comir-nt. When the class 
settles and cognitive interaction is 
reinstated, note the time and begin 
/ recording again. 

The next teacliing episode 
(Segment #59) will last approximately 
2 minutes. This will give you an 
opportunity to code some more 
complete teacher-student interactions 
This segment is relatively simple, 
however, and you shouldn't have 
difficulty in coding it. Review all 
rf the categories before beginning 
When you feel ready, go ahead with 
Segment #59. Record yotir categories 
in the spare? at the left. 



*59, You should have recorded; 



05555 44484 34834 
41144 83488 34483 
6240 



83484 84834 84835 
55441 40554 83340 



60. In the following dialogue, identify 
the category for each lettered 
statement. Letters appear following 
the statement. (All of :he 
categories are included.) 



T: 



ERIC 



If you made any mistakes or 
not agree with the above 
coding, go back through the 
tapp until it is completely 
clear. 



do 



What you've got here is a graph 
of pressure versus temperature. 

a. You pick out one pressure 

and one temperature and that 



2SH 



.15 



S: 
T: 

S: 
T: 



T: 



will tell you exactly what phase 

you are in. b. Now. under 

what pressures can liquid wate»^ 
exist at temperatures above 
100'C? c. (Silence).., d.^ 



Steve, where does it change to 

.liquid water? e. 

At 760 torr. f. 

At 760 torr. g. _ What happens 

torr? h. 



torr. g 
if you go above 



760" 

It would be liquid, i. 

It would be liquid, j. That's 

right, k. So, the question 

is, at what conditions can liquid 
water exist at temperatures above 

100°C? l._^ What would you 

say to that? m. 

I don't know the answer to tnat 
one. n._^ 

.You didn't read the assignment 

-di-d'you? o. Kathy? p. 

It can exist at pressures above 
the boiling point line, q 
That' 
r. 



s right. Exactly rightl 

As long as you can main- 

a pressure above the liquid. 



tain 

a pressure on the system which 
is in excess of the vapor pressure 
at that temperature, *the water 
will be a liquid rather than -as 

a gas. s. Now, lo9k'a,t the 

next line over. . .80"*C. t. 

^hat phase would you have to be 
in in that instance to allow 
you to boil water? u. 
It would be in the liquid phase, 
v. 

Well, you're close, w. 
Actually, in the case of boiling 
water, I'm talking about an 

equilibrium, x. That's 

kind of a tricky question.^y, 



It would be the liquid and gas 
at equilibrium if its boiling, 
z. 

S: What time is it? aa^ 



60. a. 


5 


f. 


8 


k. 


2 


p. 


4 


u. 


4 


b. 


6 


g. 


3 


1. 


4 


q. 


8 


V. 


8 


c. 


4 


ii. 


4 


m. 


4 


r. 


2 


w. 


3 


d. 


0 


i . 


8 


n. 


8 


s. 


3 


x. 


5 


e. 


4 


j. 


3 


0. 


7 


t. 


6 


y. 

z. 
aa. 


1 
5 
9 
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*61. Segment #61 of the cassette is a 
longer section — 5 minutes — and 
is generally more difficult. If 
you completed Segment #59 without 
much difficulty, you should not 
have a great deal of trouble with 
this-'section. Keep your 3-second 
interval steady and accurate. Use 
the space below to record your 
analysis. 



*61. You should have recorded: 

06666 48374 83268 34848 34834 83556 
66548 35448 24834 48358 38366 55554 
83055 55555 54483 55448 34823 45832 
35484 83234 68255 48368 38354 48434 
83482 25550 

If you made any mistakes or if 
you disagree, go back through 
the tape segment until you 
understand why each category 
was chosen. 



62. You' are now conversant in Johnson's 
Cognitive Interaction Analysis 
System and relatively proficient 
in the use of it. You art- now 
rfjady to analyze your own verbal 
interactions with your students. 



63. This completes the workbook exercises. 
You should now be able to discuss 
verbal interaction in the classroom 
in terms of Johnson's Cognitive 
Interaction Analysis System. 
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After the observation data have been collected, the numerals recorded are 
paired (tallies) and transferred to a 10 x 10 matrix. (A computer program . 
is available which will simplify the process immensely.) 

The first numeral of each pair designated '£he row while the second numeral 
of the same pair designates the column. The tally for a pair appears on the 
matrix where the two numerals intersect; e.g., a tally in the 3-6 cell means 
a 6 followed a 3 (3 preceded a 6). As a reminder, the last numeral of the 
previous pair is combined with the next numeral recorded to form the new pair: 

1 2 3 4 5 6 7 

1 

2 I . 

3 : ► ' 



Use a Clockwise Flow to Analyze a Matrix 

It is recommended that one use a clockwise flow when analyzing the. actual 
data appearing in the 100 cells of a 10 x 10 matrix. The clockwise flow 
will begin to reveal patterns on the matrix. For example, one would look for 
concentrations in the areas shaded in the matrix below to find a pattern where 
an instructor asks a question, the student responds to the question, and the 
teacher provide^ corrective/feedback. 



category 


1 


2\ 


3 


4 


5 


6 


7 


8 


9 


0 


1 






















2 






















3 




































-> 










4 






















5 
























6 
























7 


















\ 


Y 




8 














































9 
























0 














m 







One would study the shaded areas in the matrix on the next page to find 
a pattern where an instructor asks a question, the student responds to the 
question, and the teacher provides positive reinforcement. 

*From Johnson's Cognitive Interaction Analysis System and Computer Program 
by Or. Glenn Ross Johnson, June 1978. 
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2nd pair^ 



^Ist pair 
g3 3rd pair 
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1 
1 


O 


0 




a 
0 


c 
Q 


7 


0 

o 


9 


0 


1 






















2 






















3 




















4 




















p 


















5 
























6 
























7 


















> 


f 




8 


















mm, 




9 






















0 























If I want to know the kind of categories that preceded harsh criticism 
by the teacher. I would look down column seven, (excluding the 7-7 cell). If 
one or more tallies appear in the 6-7 cell, I know that cues/directions 
preceded harsh criticism. If one or more tallies' appear in the 0-7 cell, I 
know that silence preceded the harsh criticism. I excluded the 7-7 cell because 
the 7-7 cell indicates the use of criticism for more than three consecutive 
seconds. 

Conversely, if I want to know the kind of categories that follow a 
teacher's questions, I will look along row four (excluding the 4-4 cell). If 
several tallies appear in the 4-8 cell, I will know exactly the number of 
time pupils responded immediately to the teacher's questions. 

The matrix located on the next page displays the data collected by one 
observer using the Cognitive Interaction Analysis System in a college English 
classroom. The English lesson was about 30 minutes long (one tally recorded 
every three seconds; 618 tallies X 3 seconds for each tally = 1854 seconds 
7 60 seconds = 30+ minutes). 

Silence (See Table 1) accounted for approximately 4% of the total time. 
SC = Silence Category, calculated by taking the total tallies in column 0 and 
dividing by the total number of tallies. SC was 25 7 618 =4.05%. The 4% 
for silence was similar to my FIA (Flanders' Interaction Analysis) findings 
for silence in college settings. 

The teacher talked about 80% of the total time. TT = Teacher Talk; 
calculated by taking the total tallies in columns 1 through 7 and dividing by 
the total number of tallies. TT was 497 t 618 = 80.4%. The 80% teacher talk 
was similar to my FIA findings for TT in college classrooms. 

The students talked about 15.5% of the total time. PT = Pupil Talk; 
calculated by summing the total tallies in columns 8 and 9 and dividing by the 
total number of tallies. PT = 96 7 618 = 15.5%. 
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Categories 



*t5 



3 



Total 
Tallies 

% Total 
Time 



1 



8 



Cognitive Interaction Analysis Matrix 
Second number of pair 



Percentages 

SC = 4.05% 
TT = 80.42% 
PT * 15.53% 



19 



50 



8 



25 



8 



88 



15 



15 



8 



11 16 71 



1.8 2.6 11.5 



168 



27.2 



89 



115 



18.6 



10 



89 



1 - 



116 



18.8 



8 



0 



0 



56 



28 



0 I 96 



14 



25 



0.0 115.5 |o.O j4.0 



Total Tallies 

n 

16 

71 
168 
115 
116 
0 

96 
0 

25 

618 



Ratios 

PTC = 1.00 
PSSR = 0.29 
TSSR =-0.58 



Totals 

Q « 80 
CF = 52 
R = 16 



We can also look at the number of different times the teacher asked 
questions, the number of different times the teacher used correctie/feedback, 
and the number of different times the instructor used positive reinforcers. 

The teacher raised eighty different questions during the lesson. Q- 
Questions; indicates the nSmber of different times the teacher as ed questions 
Calculated by taking the sum of column 4 and subtracti. g the tallies locatea 
in the 4-4 cell. This procedure provides a fairly accurate inference. Q = 
ISs - 88 ^ 80. It seems fair to conclude that the teacher used a Socratic 
approach during the lesson. 
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TABLE 1 
Data Analysis Calculations 

SC - Silence . SC indicates the percent of the total time devoted to silence 
(each 3-seconds of silence). It is calculated by taking the total number, 
of tallies for category 0 and dividing by -the total number of all tallies. 

TT = Teacher Talk . TT indicates the percent of the total time the teacher talked. 
It is calculated by taking the sum of categories 1+2+3+4+5+6+7 and 
dividing by the total number of tallies. 

PT = Pupil Talk . PT indicates the percent of the total time the students 
talked. It is calculated by taking the sum of categories 8+9 and 
dividing by the total number of tallies. 

PTC = Pupil Talk Cognitive . PTC indicates the amount of total pupil talk 

that involved cognitive aspects of the lesson. It is calculated by taking 
the sum of category 8 and dividing by 'the total number, of tallies for 
categories 8+9. 

PSSR = Pupil Steady State Ratio . PSSR indicates "the total amount of pupil 
talk that was txtended pupil talk of more'th'an three seconds in length. 
It is calculated by taking all the tallies in the 8-8 cell plus the 9-9 
cell and dividing by the total number of tallies for categories 8+9. 

TSSR = Teacher Steady State Rat io. TSSR indicates the total amount of teacher 
talk that was extended teacher talk in a category for more than 3-seconds. 
It is calculated by taking all the tallies in cells 1-1. 2-2, 3-3, 4-4, 
5-5, 6-6, and 7-7, and dividing by the total number of tallies for 
categories 1+2+3+4+5+6+7. 

Q = Teacher Asks Questions . Q is fairly accurate inference abcut the total 
number of different times the teacher asks questions. Q is calculated 
by taking the sum of column 4 and subtracting the tallies in the 4-4 
cell . ' . 

CF = Teacher Provides Corrective/Feedback . CF is a fairly accurate inference 

about the total number of different times the instructor provides corrective/ 
feedback to student talk. CF is calculated by taking the sum of column 
3 and subtracting the tallies in the 3-3 cell. 

R = Teacher Provides Reinforcement . R is a fairly accurate inference about 
the total number of different times pupils receive positive reinforcement 
from the instructor. R is calculated by taking the sum of column 2 and 
subtracting the tallies in the 2-2 cell. 
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The teacher used 52 different corrective/feedback statements. This, too, 
is a fairly accurate inference. CF = Corrective/Feedback; calculated by using 
the total number of tallies in column 3 minus those in the 3-3 cell. The 
teacher appeared to use a substantial amount. of corrective/feedback during the 
lesson, and I think this was advisable when dealing with the new topic. The 
category 3 tallies were prompted by the large number of teacher questions 
followed by student responses which the teacher' could use for corrective/ 
feedback. 

The teacher used sixteen positive reinforcers — another fairly accurate 
inference. R = Reinforcers; calculated by using the total tallies in column 
2 minus the tallies in the 2-2 cell. 

» 

Some interesting ratios have also been provided for the Cognitive Inter- 
action Analysis System. All of the pupil talk was cognitive. PTC = Pupil 
Talk Cognitive; calculated by taking the sum -of column 8 and dividing by the 
sum of columns 8+9. PTC was 96 f 96 = 1.00. / 

Most of the talk by the pupils lasted no mpre than three seconds. PSSR « 
Pupil Steady State Ratio; calculated by taking .the sum of the tallies in the 
8-8 and 9-9 cells and dividing by the total tallies in columns 8+9; PSSR « 
28 T 96 = 0.29. 

A little over half of the teacher talk lasted more than three seconds in 
length. TSSR = Teacher Steady State Ratio; calculated by taking the sum of 
the tallies in cells 1-1, 2-2, 3-3, 4-4, 5-5, 6-6, and 7-7 and dividing by the 
sum of the total tallies in columns 1 through 7. TSSR = 4+19 + 88 + 89 t 
11 + 16 + 71 + 168 + 115 + 116 = 289 497 = 0.58. 

One can also note that c\ greater percentage of the total time was devoted 
to categories 3, 4, 5, 6, ana 8 than was devoted to categories 1, 2, 7, 9, and 

An analysis of the ratios provided me with some additional inferences to 
consider. The teacher appeared to be in complete control of the lesson 
(inference drawn from total number of tallies in all steady-state cells), and 
he/she made a substantial use of questions (category 4) and corrective/ 
feedback (category 3) to enhance student learning. The student responses to 
teacher questions were short (small number of tallies in 8-8 cell compared 
to total number of tallies in column 8). The climate of the classroom 
appeared to encourage student participation (tallies in categories 1 and 2 
versus the zero number of tallies in category 7). This was obviously a 
cognitive oriented lesson (large number of tallies in categories 3, 4, 5, 6, 
and 8j. 
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COMMENTS ON PARTICULAR UT LARGE CLASS TEACHING FACILITIES 



The Instructors who were interviewed as well as those who completed 
the Support Assistance Needs Survey made many comments about the teaching/ 
learning environment which is created in many of the large classrooms on 
the UT-Austin campus. The sp^a'fic rooms and the comments are given below. 
The rooms which the instructors liked are indicated by asterisks - one (*) 
indicates they feel it is better than thfr^ average, two (**) indicates they 
feel it is an excellent room. The rooms which the instructors disliked are 
indicated by minus signs - one (-) indicates they feel the room is somewhat 
worse than the average, two (— ) indicates they think it is an extremely 
difficult room in which to teach. 



Best Rooms 

Building and Room Number • Comments 

*AC Aud. or 21 1) Not laid out properly, difficult to see 

all students. 

2) Needs a phone line from AC to Computation 
^ Center. " ' . 

3) Good general shape and seating arrangement; 
"alkway by slide screens. 

4) Can see every member of the class. Reduces 
loud, rhetorical bombasts and need for mikes. 



**ART Aud. or 1.102 1) Not enough blackboard. Nice. Good micro- 

phone. 

Art 1.102 is designed for large classes in 
every respect. Excellent podium-controlled 
AVs. Only place. I teach my large (250+) 
class there and it is easy. 



**BEB 106 1) Excellent audio and video facilities, good 

acoustics. 

**BEB 150 1) More chalkboards (I really am old-fashioned). 

2) This is an excellent classroom. However, 
teaching would be made much easier if a 
wireless microphone system could be installed. 

3) I think BEB 150 is a good room. One needs 
ample aisle space, which it has. Could 
use more blackboard space, sides as well as 
front. 

*BUR 106 1) I'm tip on stage. Media specialist (is there). 

2) Lower the stage. 

3) Good lighting; wide aisles. 
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Comments on UT Classrooms - p. 2 



Building and Room Number Comments 

*BUR 109 1) Install some left-handed desks. 

2) Good sight-lines, bright lighting, enough 
blackboards, and especially the presence 
of a media* attendant to whom I can simply 
hand my slides at the beginning rf the hour. 

BUR 112 1) PA system really works! 

**EDB 10^ or ALKIVA 1) Beautiful'- perfect. Comfortable chairs. 

Media assistant. Circular configuration, 
s You can teach 30 or 120. 

2) Room is fine. 

3) Good design; acoustics, furniture; lighting; 
AV equipment; microphone. 

^ 4) Good arrangement and media facilities. 

**GEO 100 1) It is fully equipped. 

2) The room -lights and projectors operated from 
podium in front; screens are high out of the 
way of heads and the blackboards. Also, 
there are two levels of blackboards which 
slide up and down so that early lecture 
material can be saved and used throughout 
the lecture for reference. 

3) Easy to hear; equipment which wor/.s. 

**GSB 1.216 1) Very nice. Magnificent room. Slant and 

spacing of chairs. Back row not too far 
away. Seats are comfortable. Don't hp.ve 
to use a mike. Can maintain eye contact 
with students. 

2) All GSB rooms are excellent. 

3) All classrooms in GSB are excpllent. Fully 
equipped and comforatable for the students. 

4) Full range of multi-m^dia equipment; the 
seating arrangement is such that one feels 
close to the^students. 

**GSB 1.218 1) Excellent room; well lighted, etc. Audio 

visual equipment, etc, etc. 

2) An excellent room. 

3) Excellent. 

4) Space; lighting facilities; desks for all 
students with plenty of elbow room; no 
acctrss problem for those who come in late;. 

' full media facilities. 



Comments on UT Classrooms 

Building and Room Number 

**GSB 2.202-2.204 or . 
others on this floor 

* Jester Au(J. or A121A 



- p. 3 



Comments 



*PAI 301 



WEL 



**WEL 1.308 and 2.246 



1) 



1) 
2) 
3) 



4) 



5) 
6) 

7) 



1) 



2) 



1) 



2) 



1) 
2) 

3) 
4) 
5) 
6) 
7) 



Multimedia facilities; good sound facilities; 
adequate board space; set up for good eye- 
sight contract. 

Nicest I know on campus. 
Works very well as is . 
Heating/cooling controls unaccessible; 
frequently uneven, uncomfortable climate; 
desperately need flashlight-pointer for use 
on slides; would like a cordless microphone. 
Needs an adequate electric pointer to take 
better advantage of the excellent rear- 
pro jecti on.? ?*":cr5. Needs a W^illensak 
sound-slide unit. 
AV staff needs improvement. 
Media available; support technical person 
on duty. . . 

This classroom is far. superior to other 
classrooms I've used (e.g., BUR 106). I'm 
told AC 21 is even better. 

This room is quite nice in contrast to almost 
any other lecture theatre which has been > 
assigned to Biology lecturers (with the 
exception of the new Welch Auds;). 
Large, good air circulation, good projection 
room and equipment available to lecturer or 
TA, good acoustics. 

Any one of the large classrooms in the new 
portion of WEL are good. I need space 
between each student to aid in determination 
of individual work on daily quizzes. 
It had intimacy. Good acoustics means that 
you can communicate with every member of the 
class. Reduces loud, rhetorical bombasts and 
need for mikes. 

Ability to use more than one overhead. 
It ir a fine classroom. However, the pro- 
jector controls don't work. 
Fine. 

Excel lent. 

Multiple overhead capacity. 
Acoustics, primarily, and seating. 
Excellent lighting, acoustics, and AV 
facilities. The staff in charge of these 
rooms are very competent and are very 
cooperative; their assistance greatly releives 
the instructor. 
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Comnents on UT Classrooms - p. 4 

Building and Room Number Comme nts 

WEL 1.308 and 2.246 (con't) 8) The facilities and media-assistants were 

very^goOd, but the physical structure of the 
auditorium ii even better. I have no 
problems cqnciucting discussion sections for 
80 people; there is some intimacy. 
9) Excellent acoustics and media facilities; 
comfortable, attractive enviisonment. 

*WEL 1.316 1) Lighting could be better for students. 

2) Improve lighting; it 1s very uneven and 
difficult to control, especially when half 
the bulbs are burned out. 

3) It is an excellent classroom. 

4) Excellent acoustics and media facilities. 

5) Good space, acoustics, support. Is isolated 
from competing noise. 

6) No problems, " 

W£L 2.222 1) Spacious; good sound; good projection 

facil i ties . 

*WEL 2.224 1) Could be better acoustically. Only one 

overhead screen. Lighting is bad, especially 
in the front rows. Really nice. AV specialist, 
Not too long and not too wide. 
2) Ability to handle 2 overnead projectors at' 
one time would be nice. Better lighting 
in first 3 rows. 

**WEL :?.246 1) Would be difficult to improve. It i? an 

excellent facility that is made even more so 
by the assistance of the AV staff in Welch. 

2) AV staff. 

3) Fine. 

4) Also, WEL 1.316 and 1.308 are good. Acoustics 
are excellent. WEL 2.220 is also go^^ for 
over 400 students, but blackboards cannot 

be used effectively. 

5) It is comfortable, modern and extremely 
functional. Gives instructor access and 
control of lighting, etc. Has excellent 
audio-visual ca^icity. Excellent room! 

WEL 2.308 1) The room is wel 1 -arranged. The acoustics 

are good. 
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Comments on UT Classrooms - p. 5 



Building and Room Number 
**WEL 3.502 ^ 1) 

2) 

3) 

4) 
5) 

Worst Rooms 

"BAT 7 ; 

c) 

. * 3) 

4) 

5) 
6) 



Comments 

No chalk. Nice, wide instead of deep. 
Media assistant, 

This room is great for my course. It has . 
lost of blackboard space, which is what I 
need most J Also the students are not too 
far back (the room is not deep - front to 
b.^ck; deep rooms can be a problem). The one 
problem is that the (more or less permanent) 
podium blocks the view of students in the 
first few rows. 

Has a full-time person to run audio visual 
equipment.'* That is a very nice feature of 
the room. The room is nearly perfect, but 
I could not find chalk many times. 
Again, for my purpose: large blackboard, 
students not too far away; easy entry/exit 
for students (to jninimize disruptions). 
Roomis wide, but not deep so the students 
are close to the front. Entrance to the 
room are in back so. late students don't 
distract too badly. Good blacl'boards; 
sloped seating area; good acoustics; good 
lighting. 



On a gtage. Not enough board space. Stage 
is dark. Equipment is not accessible. 
Can't see the students in the back. 
Larger blackboard which would be visible in 
the back of the room. Facilities for 
hanging wall maps and charts. Light controls 
accessible to the instructor. PA system 
which is reliable (it was down for over 
a week; presently makes a distracting 
noise). 

Bad acoustics; room is too large for 
effective teaching; poor blackboard space; 
stage is huge and dark. 
Oil the desks so they don't squeak so much 
when being raised and lowered. Take out every 
other row of seats (or so) to eliminate the 
need to lower desks in order to walk down 
an aisle. 

Better sound system, control of lights '{py 
instructor) and more electrical outlets so 
one can use microphone as well as other 
projection equipment. r 
More blackboards; better sound system. 
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Coinments on UT Classrooms - p. 6 

Building and Room Number Comments 

--BEB 151' 1) 15 seats/row (cramped). Disasterl Low 

student ratings. Late students very 
disruptive. Cramped seats. 

2) This is- perhaps the most difficult room in 
the BEB. ^The students rated it in the 
bottom 20^ of classrooms. Frankly, nothing 
short of complete renovation would do. 

3) No real complaints. 

4) These rooms are compact and are very good 
for lecture and discussion. Their only 

• drawback is that the seats are so close 
together, exams cannot be given in them. 

--BEB 155 1) Overhead screen too high to reach. No 

built-in visual aids. Not enough blackboard 
space. Acoustics not too good. Seats very 
uncomfortable. Bad student evaluations . 

2} More board Space. The current chalkboard 
is 12-14 ft.* high and 6 ft. wide. I am 5'5". 

3) This room should be gutted. The auditorium 
style chairs should be replaced with seating 
similar to that in GSB 1.218 - chairs with 
long desks in front of the students. 155 is 
murder on students and faculty. 
, 4) Acoustics -are poor^"pTacing a strain on the 

voice of the lecturer (there is no amplificati 
equipment) and the ears of students beyond 
midway in the lecture hall. The decor is 
depressing, frankly, and there are no 
arrangements for audio-visual machinery to 
be installed on a semi -permanent basis. 
Even the lighting leaves something to be 
desired. Some of the seats were borken and 
never ^ixed throughout the semester. All 
of these defects need to be remedied. 



-BEB 166 '1) Awful for exams. Chairs nailed down. 

2) BEB 166 seems to be a nice room for a large 
tlass. The semi-circular construction of 
tlie seatirfg seems to give a good feeling to 
the class atmosphere. 

3) This room is terrible for exams. Need aisles 
■ in the room, less crowded. 

* * ■ ' 

-BEB 360 . ' 1) Terrible place to have a seminar. Doubt any- 

one in the Business school discusses »anything 
^- We moved (illegally) to the Union. 
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Conments on UT Classrooms 
Building and Room Number 
BUR 116 



- p. 7 



BUR 212 

BUR "Wells" 
EC J 1.202 

--GAR 1 



—GAR 3rd floor 
GEA 105 

GOL 105 

Hogg Aud. 
— Jester A217A 



Comments 



Too narrow! Last rows are miles away! No 
outlet in the middle of the room for my own 
projector. Microphone cord is too short. 
Microphone won't attach around neck. Make 
a new outlet. 

This is not a pleasant classroom. However, 
an earlier attempt to remodel it was not 
very successful . 

YUK!! 

Amplifier for PA system was not functioning 
for most of Spring 1981. Sometimes over- 
head projectors are unreliable. 

Satisfactory. 

Bad teaching environment. Students have 
difficulty in hearing. Little equipment. 
The equipment available Is an overhead and 
a vacuum-tube microphone which doesn't 
work!! 

Is a dungeon. Hard to conceive a place less 
conducive to learning. But much better than 
the "pits" in Burdine which are an educational 
disaster! No ai r conditioning (i.e., sleepy 
students). 

Garrison Hall is horrible!" Noisy, crowded, 
etc. , etc. ! 

Better ventilation system, less squeezed 
together, and narrow chairs; less noisy 
chairs. 

Huge room with all those little chairs. 
Ugh! 

Terrible! ! 

Attrocious. Wider than-deep so you have 
your back to some. No AV facilities. 
Floor is flat. 

The room is mudi wider than it is long - 
the students on the ends of each row can't 
see the board. 

Lack of screen; impossible to show slides. 
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Comments on UT Classrooms - p. 8 
Building and Room Numbe r ' 
PEB 311 



-RLM 4.102 

SSB 410 
WEL 2.310 
WEL 3.305 

Uooldrldge Labs 
WRW 102 

WRW 201 

Muequate Rooms 
BEE 161 
BEB 165 
BEB 265 
BEB 458 
BEL 222 



BEN 22> 
CAL 100 



Comments 

Not effective for classes larger than 50 
students. The room is not one that could 
be improved very much for large classes 
(up to 95 students) » 

Makes you feel like there are alligators in 
a moat between the students and you. Not 
enough board space. 

Don't have the ability to fuily darken the 
room for slides and films. 

The room is a bunker, but nothing can be 
easily done about it. 

Extended tables instead of arm-chairsj 
slower rise, to the rear of the room; more 
space per. student. 

Less of a theatre atmosphere. 

Too crowded. Students too far from board 
to see well . 

Acoustics bad. Stuffy. Cramped. 



Seems o.k. 
Good. 

No real complaints. 
No problems. 
Worst one. 

Nice room, but needs more blackboard space, 
less of a stage. A stage creates a barrier 
to good teaching. 

O.K., but could use better audio-visual 
facilities. 

Classroom as such is adequate. However, 
there has been constant noise from workmen, 
which on several occasions has disrupted 
the class. 

Good acoustics, stage about level with audience 
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Comments on UT Classrooms - p. 9 

Building and Room Number Comments 



0 . 



CMA Aud, (A2.320) 1) Need better equipment (that doesn't always 

break down), and good technicians. 
2) Very nice. 

GB 100 1) O.K. 

GEA 101 1) Lock the exterior door so people cannot enter 

while the class is in progress. 

6.SB 1.212 1) More intimate, informal atmosphere. 

Hogg 14 1) Students are all in easy eye contact and it 

is possible to hear and answer their 
questions withcut using a microphone and 
amplifying system. 

MEZ 420 1.) Need a larger seminar room. 

PAI 2.48 1) These are relatively new classrooms. They 

are generally comfortable but seating is 
somewhat crowded. 

RLM 6.114 1) O.K. 
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APPENDIX H 
CREATING NEW REWARDS FOR FACULTY" 
article by John M. Bevan 
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Creating New Rewards for Faculty 



by John M. Bevan 
Vice President for Academic Affairs 
College of Charleston, South Carolina 



It is not too surprising that few incentives have been introduced tc 
encourage continued development, renewal; and evaluation of faculty. 
The rewards as catalogued are promotion, tenure, modest salary increments 
teaching load reductions, and' occasionally a distinguished chair. After 
tenure, very little beyond promotion to the rank of full professor can 
be expected, except the final gesture of "professor emeritus." Maybe 
there's an "Outstanding Teacher Award" or an "Outstanding Research Award" 
along the way, but these are not specific attainments faculty members 
strive for or request. \ 

Somwhere we've lost sight of faculty as a group of very different individ 
uals needing varieties of incentives and opportunities to stimulate arM 
extend potential. Faculty evaluation repeatedly substantiates this judg- 
ment, yet the reward response to it is standard and somewhat sterile. 
With the encroachment of the "steady state" status it becomes imperative 
that new approaches to reward be explored - approaches that are less 
summative in character and more reinforcing in a dynamic process. Follow 
ing are a few suggestions. 

I N-HOUSE VISITING LECTURERS . During an interview with her dean, an 
associate professor In art history mentioned she would be interested in 
serving as a resource person to colleagues, i.e., entertaining invita- ■ 
tions to lecture in colleagues* classes where her expertise could be 
used. Following an extended discussion of these suggestions, the young 
professor was given a one-course load reduction for the fall and spring 
semesters and her appointment as an in-house visiting lecturer was 
announced to her colleagues. 

By the middle of the next summer, her fall program was scheduled with 
lectures, such as "Scientific Concepts of the Modern World as Reflected 
in Art" (Introduction to Biology), "Man's Visualization of His Gods" 
(History of Religion), "The Interaction of Mind-Eye Patterns" (General 
Psychology), "Transformation of Medieval to Renaissance as seen in 
Visual Art" (History of Western Europe), "Concepts of Baroque Style" 
(Baroque Music). 

Requests to lecture were followed always by a conversation with the 
respective colleagues to determine objectives and purposes for the 
presentation. Also, conversations were held after l<^ctures and requests 
for additional lectures were frequent. Both colleagues and lecturer 
reported great satisfaction and a desire to continue the arrangement 
because of its implications for strengthening interdisciplinary studies. 

As a result, consideration is now being given to designating, on a three- 
year rotating basis, one visiting lecturer from each of the four academic 
divisions. Such an appointment, regarded as prestigious, stresses the 
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importance of faculty members as resource persons and provides satisfactions 
supportive of dynamic development. 



SEMINAR FOR FACULTY - A TRAINER RESOURCE . In writing to his department 
chairperson » one faculty member stated, 

I would like to see selected faculty members teach 25 
percent fewer courses over a designaited period of years 
nad use the available time to improve the quality of the 
institution in other ways. For example, a faculty member 
could conduct a year-long seminar that would be of in- 
terest to colleagues and students in his or her own and 
related departments. .He or she could act as a mentor to 
colleagues interested in learning more and possibly doing 
research involving his or her field. 

The department to which this faculty member belongs had been responsible 
for introducing a mini -computer to the campus and for offering a two- 
semester seminar in computer languages to 18 faculty members from eight 
disciplines. Because of the extensive use faculty and students are 
making of them, 15 terminals and disc storage capacity are now inadequate. 
In such an undertaking, the ^acuity members who are involved derive a 
sense of their importance to the development of their colleagues, their 
department, and their institution. 

MASTER TEACHERS . One of the fascinating contradictions in academe is 
the practice of reducing a professor's teaching load as a reward for good 
teaching. An outstanding teacher is relieved of courses in order to do 
research, when it would seem more appropriate to reduce teaching activities 
to make more of the person's time available to others who might benefit 
and learn from his or her supervision in perfecting approaches to in- 
struction. 

Such a person could be designated as a Master Teacher, given a three-year, 
11 -month contract with a one-course load reduction each semester. Summer 
would provide opportunities to update teaching, prepare seminars for 
faculty, and be a resource person to colleagues in matters pertaining 
to the philosophy and improvement of teaching. The Master Teacher could 
work individually, or with others similarly designated, presenting-seminars 
or lectures to interested colleagues, conducting mentor training sessions, 
and being available generally for observation and discussion. 

These Master Teachers would represent a core of faculty concerned about 
good teaching and the correlation of academic programs to institutional 
objectives. 

* 

DISTINGUISHED RESEARCH PROFESSORS . These individuals would be so desig- 
nated because of their recognized accomplishments in research, their 
knowledge of funding sources for research, their enthusiasm for and 
encouragement of scholarly pursuits, and their willingness to assist 
colleagues in designing and preparing research proposals. One such 
person could be chosen from each of the academic divisions, and contracts 
similar to those of Master Teachers arranged. 




These persons would not replace the staff officers responsible for providing 
support services for research efforts, but would supplement their services, 
including providing assistance with research planned to study outcomes of 
new instructional approaches. Of course, if a director of research is not 
available, then these faculty may help fill that void. 

It should be recognized that Distinguished Professors would not go about 
campus checking to see whether colleagues are. doing research. They would 
be available to encourage and aid faculty* who express an interest in 
research, e.g., running interference for those trying to secure research 
space, finding seed money for pilot studies, or obtaining a reduction in 
teaching load for others needinj time for writing. As well as being 
resource perjsons on campus, they could serve as scholar examples. 

MINI-GRANTS . Mini-grants can be an important means of maintaining and 
enhancing personal growth and a source for professional and instructional 
improvement. It's surprising how such grants can enhance educational 
climate, help shape the faculty as a dynamic resource pool, stimulate 
attention to the skills of teaching, and provide the transition from 
minimal scholarly pursuits to mature scholarship. Excerpts from the 
regular annual report of a physics department exemplify the role of such 
grants as well as the dynamics of the resource pool concept mentioned 
earlier. 

One faculty member, aided by a mini-grant, attended a 
Department of Energy-funded education workshop and is 
helping to develop, through the Center for Metropolitan 
Affairs and Public Policy, a grant proposal which in- 
cludes a city/college energy conservation program. When 
funded, this proposal will also provide undergraduate 
research opportun-^ties. Another faculty member will con- 
duct seminars on teaching for the department and other 
interested colleagues to pass on what he learned from 
his contacts with a nationally known teacher during 
three weeks sponsored by the college mini-grant. 

Tentative plans are being made to turn a room in the science building 
into a learning center. The room will include individual study areas, 
a mini-computer terminal, space for long-teiin lab projects, and a 
testing area for a self-paced course... 

In addition, we will continue to be active participants in 
campus faculty development activities and off-campus pro- 
fessional conferences and workshops. We feel that these 
activities will lead to improvement in the overall scholar- 
ship and learning climate at the college. (Morgan, 1979) 

INTERNAL SABBATICALS . Sabbaticals are typically available afte- eaci 
six years of full-time service, with full £-!ary provided for one semester 
or half salary for two semesters. Under thii scheme, the average faculty 
member winds up taking advantage only of one sabbatical in three because 
of inconvenience, cost, unpreparedness, or inability to "break" the 
routine. Yet, sabbaticals are designed to function as "growth" periods. 
This being the case, they should be more frequent and "implanted" into 
the icheme of routine. 
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For instance, If every eighth consecutive semester a faculty member were 
free of regular responsibilities to engage in research, writing, and study 
according to an agreed-upon plan, and if everyone in every department 
were scheduled similarly but in a rotating arrangement, a creative, 
dynamic atmosphere might ensue. 

The mechanics are rather simple: a faculty member is not scheduled to 
teach during the eighth semester and no r,eplacement is employed. Course 
schedules are published for a two-year period to allow majors to arrange 
required courses well In advance, assuming that all required courses are 
offered v/ithin any two-year period. Within this scheme sabbaticals would 
occur in a younger faculty member's career immediately following the 
critical third-year evaluation and in time to define a program that might 
take into consideration pertinent observations and recommendations. . 

A second sabbatical would follow closely the tenure decision. In fact, 
it would not be difficult to arrange subsequent summative reviews to 
coincide with regularly scheduled "growth" leaves. 

Many within and outside of acadme will look on such a scheme as "feather- 
bedding." When one-eighth of a staff is free every semester, even though 
it is to engage in activities that enhaoca the institution's thrust, the 
inevitable conclusion will be drawn that funds are being wasted in over- 
staffing. This is unfortunat-i because such a program is needed to maintain 
vitality during a steady-state period when little new blood gets into the 
system. It is a reward format and at the same time a prescribed antidote 
to the lethargy that routine inflicts on academe. 

BANKING CREDITS . In a few colleges, course credit overloads or hours 
hours credited 'for directing independent study are "banked," and when 
the equivalent of a semester's load has been accumulated (usually within 
a designated time period, such as three years), the holder of the "banked" 
credit!" is entitled to a semester's leave for study and research. Like- 
wise, an overload in one semester may mean an equivalent load reduction 
in the next semester. 

Through this means, faculty members may secure time for writing, fo 
working up new courses, for doing research to improve classroom inicruc- 
tion, for spending addit-'onal time with students in independent study. 
Banking time for creative ventures (time to be creative) is based on 
dolUrs earned frohi tuition paid for hours taught and for which no extra 
compensation was paid. 

AFTER-TENURE REWARDS . For all intents and purposes, formal evaluation 
ends when tenure begins. It appears to be assumed that the level of 
accepted competence attained in the six-year probationary period will be 
maintained and enhanced. Furthermore, it appears that the reward systems 
within academe were defined to reinforce efforts during the period of 
probation primarily, because after tenure the only remaining plus most 
faculty might expect is promotion to professor or ihe distinction of hold- 
ing a departmental chair reserved for the exceptional few. 
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So much more 1n the way of creativity and production may result from 
post-tenure evaluation scheduled at six-year intervals, and an added 
salary increment might be the reward for significant and continued 
development after each such evaluation. If this added increment were as 
much as $1500. the total increase in salary over a career could be very 
substantial. Too, other rewards limited to*tenured professors should 
make a difference, e.g., partial support for study abroad or opportunity 
to participate in certain internships and exchange programs. 

AFTER RETIREMENT - PROFESSOR EMERITI . The assignment of professors 
emeriti to the library can broaden the intellectual offerings of the 
library by identifying learned and experienced individuals as consultants 
and by making available library resources to which students might not 
otherwise have access. 

A job description for a "Coordinator of Library Resources" in one college 
'included the following: 

...would supervise the work of three to five professors 
emeriti and librarians emeriti of the college. The emeriti 
would be given office space in the library and would work 
in close conjunction with the Coordinator of Library Re- 
sources .... 

In this program the talents and experience of professors emeriti who be- 
come members of ^he reference staff are utilized to support students i^|^ 
their special projects, in tutorials, and in independent study. They 
provide assisudnce also to the regular faculty and are expected to be 
familiar not only with library resources at the college, but also with 
those of the libraries of the region. They advise students concerning 
library resources and the special skills and interests of college personnel. 
They provide the usual advice., guidance, encouragement, and evaluation 
for as many student projects es their abilities and activities allow. 
When feasible and appropriate, the emeriti accompany students to libraries 
and research centers of neighboring institutions. 

The professors emeriti in the library can open many doors which the pro- 
fessor in the classroom can refer to only by way of reconmendation. 
Students have a resource, and aging faculty have a continuously rewarding 
outlet. Too, such professors augment their retirement income in an amount 
up to the Social Security allowance, or according to the salary differen- 
tial of the professor at the time of retirement and that paid his or her 
young replacement. An annual informal evaluation determines future assign- 
ments to students. (Bevan 1978) 

LITTLE THINGS , These "little things" not only give satisfaction, they 
contribute to growth. A professor writes an article and is surprised 
and pleased when a colleague comments on its content, and when the dean 
sends a note indicating appr.ciation and the desire to discuss the thesis 
and conclusions put forth. Or, a professor derives benefits from critical 
reactions to the results reported on a new instructional approach intro- 
duced into a course. Or, reinforcement is received when a student or 
colleague expresses "thanks" for assistance in arriving at a critical 
decision. Or, one receives support when told that every lecture is better 
than the last. 
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The most meaningful comment a colleague a colleague made to me early In 
my career was to the effect that had he been giving my lecture, he could 
have done a much better job In getting my points across. The 30-m1nute 
conversation that followed Introduced me to mahy of the subtleties about 
formal presentations and how to "monitor student reactions when lecturing. 
It's Important to remember that both positive and negative recognition 
Is more effective for learning than no recognition at all. Too. never 
enough in the way of little things is sai^l between colleagues, when 
frequent "".y these little comments. 1f straightforward and sincere, best 
serve to help a colleague know how he or she stands. 



Excerpted with permission from UTA Insight to Teaching^ Excellence . 
Vol.8. No. 2. March .1981. The University of Texas at Arlington. 
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APPENDIX r ' 

ONE STl'OENT'S REACTION TO LARGE CLASSES 
(Article from THE DAILY TEXAN) 
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Pane 2 □ THE DAILY TEXAN □ Tuesday, July 18, 1_9Zg. 



Reporter's 
Notebook 



The other day 1 was sitting 
in a room full of' ad- 
ministrators and educators, 
listening attentively as tKey 
deliberated on the subject of 
small classes. 

'There is a need to cut down 
on the number of small 
classes a university 
provides/* one educator said. 
' We Just can*t afford to have 
them." 

I admit small classes may 
be costly to individual in- 
stitutions, but if we were to 
eliminate money as a primary 
f;)^tor. it might be interesting 
t look at who is really being 
hurt by the elimination of 
small classes - faculty or 
students. 

BEING A student at the 
University gives me some 
. authority to speak on the 
: effect of larger classes as a 
' means of effective teaching. 
As a Ireshman, I enrolled in 
a biology class, along with at 
lo'jja 200 others. Not having 
gone to a high school where 
large classes were taught, the 
si2e of the class inhibited my 
participation and willingness 
to learn. 

I was easily distracted by 
the noise level in the room, 
and if I arrived 15 minutes 
before the class was to begin, 
the best seat I could find was 
on the last three rows. 

Never having been a 
number, a nameless creature 



whom my professor would 
probably never meet. I felt 
slighted by the education I 
was getting, thinking this was 
not the best way for me to 
learn. 

VM NOT advocating in- 
dividual instruction or classes 
with only 10 students, but I 
feel that classes of 100 or 
more are a disservice to the 
students. 

No one asked student opi* 
nion when deciding whether to 
eliminate small classes from 
the formula funding. But 
without student input, there is 
no need to discuss faculty 
salaries or workloads. If stu- 
dent level decreased and the 
University was no longer tiie 
largest in the state, there 
would be no argument as to 
how many hours an instructor 
must spend in direct instruc- 
tional activities* for the 
number of classes would ul- 
timately decrease while facul- 
tv levels might remain the 

.me. 

Do people really consider 
what is best for stuclents when 
making important decisions 
that ultimately effect them? 
Do Legislators really want to 
know what faculty members 
are doing with their time or do 
they want to ensure that 
students will receive more in- 
dividualized instructional 
time as a result of the repor- 
ting system? 



THE FACT THAT the 
definition of small classes has 
been a controversy for several 
years should make educators 
re-evaluate where their 
priorities lie. 

For while administrators 
continue to argue over the 
deiinition, classes do not 
become smaller, but continue 
to get larger. 

Is there a limit as to the 
maximum number of students 
which can be enrolled in a 
class? Of course, students 
hear a class Is closed at adds 
and drops, but that seems to 
be the only time we hear of 
limits as to the number of 
students that can be placed in 
one class. 

ONE MUST STOP to con- 
sider the possibility that space 
is the only factor preventing 
classes from reaching a level 
of 300 students, and if that is 
the reason I regret what 
others will face when they 
come to college hoping to 
enhance their education. 

Small classes may soon 
become a thing of the past, 
but I would hate to see our 
educational system be more 
concerned with the financial 
loss it would suffer as a result 
of teaching small classes, 
than the education of its 
students which the state 
claims is its No. 1 priority. 



BEST copy 
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